Raycaster/ Eval

APEX-Agents · Law

World423_DPM_01

Best published2/2Pass

APEX-Agents task World423_DPM_01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 423Dual harnessGrader: rubric
task_73363f7afa084f98aeb61ff19ecfabad
Law World 423
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Evaluate whether the breach notification requirements to EU/EEA customers in Version 1 of the Breach and Incident Response Policy are compliant with the GDPR, by answering the following questions: 1) Whether the notification section in the policy is compliant in regards to EU/EEA customers (Yes/No). 2) If not, what must be added to the notification? If complaint, state no revisions are required. Tell me your answer right here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.4 minidual2/2Pass
fireworks models Kimi K2dual0/2Fail
Gemini 3 Flashdual0/2Fail
Gemini 3.1 Produal0/2Fail
GPT-5.4dual0/2Fail
GPT-5.4 nanodual0/2Fail
GPT-5.5dual0/2Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States “Yes”, the notification section in the Breach & Incident Response Policy is compliant with the GDPR regarding EU/EEA customers

  2. States that no additions need to be added to the notification requirements