APEX-Agents · Law
World423_JS_08
APEX-Agents task World423_JS_08 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Determine if Northstar can be fined under Article 83 of the General Data Protection Regulation ("GDPR") for a violation of Article 14(2)(e) of the GDPR for the data transfer from the Data Analytics Module (the "Module") if there is a finding that BlueQuill did not process personal data when it received the data from the Module. Please provide a yes or no answer to me here as a message, with a brief explanation.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/2 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/2 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/2 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States Yes, Northstar can be fined under Article 83 of the General Data Protection Regulation ("GDPR") for a violation of Article 14(2)(e) of the GDPR for the data transfer from the Data Analytics Module (the "Module") if there is a finding that BlueQuill did not process personal data when it received the data from the Module
States that the data transmitted by Northstar via the Data Analytics Module contained pseudonymized personal data