Raycaster/ Eval

APEX-Agents · Law

World423_AW_01

Best published2/3Fail

APEX-Agents task World423_AW_01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 423Dual harnessGrader: rubric
task_56c618b6f1884f168f3e508af61b2d3d
Law World 423
message_in_console
6 models · dual config

Task prompt

What the agent was asked to do

Our client needs to know if any of that data that was transmitted in the breach is considered personal data under GDPR. Review the four attached incident reports and provide your reply to me with exactly the following: 1) a single sentence conclusion identifying if there are any discrepancies among the documents in relation to the data breach; and 2) 1-2 sentences of analysis as to whether the type of data involved in the breach is considered "personal data" under GDPR.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
fireworks models Kimi K2dual2/3Fail
Gemini 3.1 Produal2/3Fail
GPT-5.4dual2/3Fail
GPT-5.4 minidual2/3Fail
GPT-5.5dual2/3Fail
GPT-5.4 nanodual1/3Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that there is a discrepancy among the documents in relation to the data breach

  2. States that the Privileged Assessment identified the instance_region descriptor as a pseudonymous identifier

  3. States that a pseudonymous identifier is considered personal data under the GDPR