APEX-Agents · Law
Law_World_423_DM_05
APEX-Agents task Law_World_423_DM_05 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Northstar's US customer, Zellwerk, reported a system-wide outage that delayed access to shipment-tracking data containing health-related product identifiers and customer account IDs. During the outage investigation, Northstar's internal team discovered an unapproved third-party analytics module embedded in the US and European instances of the platform for "temporary performance monitoring." The General Counsel has reached out asking if Northstar's data practices would be considered unfair under the Federal Trade Commission Act. Make a NEW document, and prepare a short memorandum with a summary of the relevant legal authority, analysis, and a conclusion.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 3/9 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/9 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 2/9 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 2/9 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/9 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/9 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 1/9 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that consumer injury could not reasonably have avoided is a required element for a finding of unfairness under the FTC Act
States that a violation of public policy is a required element for a finding of unfairness under the FTC Act
States that unethical or unscrupulous activity is a required element for a finding of unfairness under the FTC Act
States that substantial consumer injury must have occurred in its net effects in order for a practice to be deemed unfair under the FTC Act
States that an exemption to "substantial injury" involves analyzing whether the injury is offset by consumer or competitive benefits of the activity
States that Northstar did not cause a substantial injury
States that Northstar did not violate public policy
States that Northstar's actions do not constitute unethical or unscrupulous practices
States that Northstar did not engage in unfair practices in violation of Section 5 of the FTC Act