APEX-Agents · Law
World421_TG_01
APEX-Agents task World421_TG_01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
We just received a Civil Investigative Demand from the Federal Communications Commission (“FCC”) regarding our text marketing campaign to promote our reverse mortgage product. The interrogatories indicate that we utilized an automated telephone dialing system to send text messages to 78,000 seniors without securing their express written consent in violation of the Telephone Consumer Protection Act (“TCPA”). 6,430 of those seniors opted out of text communications previously, 526 are on the Do Not Call Registry, 1000 were texted by a third-party marketing agency we hired to promote the product, and 650 were texted customers of SLL being notified of a data breach. I anticipate that we will be fined and that the fine will include both “willful or knowing” and “National Do Not Call Registry” violations. Please calculate the total maximum amount that SLL will be fined (based on the current fine amounts in December 2025) and send it back to me. Also break down the fine into its "National Do Not Call Registry" and TCPA components. If needed, round the amounts to the nearest dollar. Concisely explain your reasoning. Just print the answer straight back here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 0/3 | Fail | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 0/3 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 3/3 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 0/3 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/3 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 0/3 | Fail | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States the total fine amount for National Do Not Call Registry violations is $27,924,288
FailEvidence: <TEXT_RESPONSE> states “National Do Not Call Registry component: $13,219,432.” Assessment: Criterion requires stating the total fine amount for National Do Not Call Registry violations is $27,924,288; the response gives a different amount, so fail.
States the total fine amount for TCPA violations is $116,025,000
FailEvidence: <TEXT_RESPONSE> states “TCPA component: $2,892,735,300.” Assessment: Criterion requires stating the TCPA violations fine is $116,025,000; the response gives a different amount, so fail.
States the total maximum amount SLL may be fined is $143,949,288
FailEvidence: <TEXT_RESPONSE> states “Total maximum fine: $2,905,954,732.” Assessment: Criterion requires stating the total maximum amount SLL may be fined is $143,949,288; the response gives a different amount, so fail.