Raycaster/ Eval

APEX-Agents · Law

World423_JS_07

Best published1/2Fail

APEX-Agents task World423_JS_07 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 423Dual harnessGrader: rubric
task_c9fa280149be4bbb99fc9f9065b443cf
Law World 423
message_in_console
6 models · dual config

Task prompt

What the agent was asked to do

Will Northstar be required to compensate affected data subjects under the General Data Protection Regulation ("GDPR") for the Data Analytics Module's (the "Module") unauthorized data transfer if the data transfer violated the GDPR? Please respond to me in here with a yes or no answer and a brief explanation.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
fireworks models Kimi K2dual1/2Fail
Gemini 3.1 Produal1/2Fail
GPT-5.4dual1/2Fail
GPT-5.4 minidual1/2Fail
GPT-5.5dual1/2Fail
GPT-5.4 nanodual0/2Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States No, Northstar will not be required to compensate affected data subjects under the GDPR for the Data Analytics Module's unauthorized data transfer

  2. States that any harm suffered by the data subjects from the Data Analytics Module's unauthorized data transfer is negligible