Raycaster/ Eval

APEX-Agents · Law

World423_DPM_02

Best published2/4Fail

APEX-Agents task World423_DPM_02 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 423Dual harnessGrader: rubric
task_327f2507ef39488d9dfc3fbf05ef4c2f
Law World 423
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Review the Controller-to-Supervisory Authority Notification Template, along with the timing set out in the V.2 Breach & Incident Response Policy, to ensure compliance with the notification requirements of the General Data Protection Regulation (GDPR). Draft a message to me here that answers Yes or No as to whether each policy is compliant. If not compliant, propose any necessary additions.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.4dual2/4Fail
GPT-5.4 minidual2/4Fail
Gemini 3.1 Produal1/4Fail
fireworks models Kimi K2dual0/4Fail
Gemini 3 Flashdual0/4Fail
GPT-5.4 nanodual0/4Fail
GPT-5.5dual0/4Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States Yes, the Controller-to-Supervisory Authority Notification Template is compliant with the GDPR notification requirements

  2. States Yes, the Breach & Incident Response Policy is compliant with the GDPR notification requirements

  3. States that no additions are needed to make the Controller-to-Supervisory Authority Notification Template compliant with the GDPR’s notification requirements

  4. States that no additions are needed to make the V.2 Breach & Incident Response Policy compliant with the GDPR’s notification requirements