Raycaster / evalsBack to AI Agents for Privacy and GDPR Compliance

APEX-Agents · Law

World434_AH_02

1/1Pass

APEX-Agents task World434_AH_02 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 434Dual harnessGrader: rubric
task_8c0bbdb42c96492eaa39ab908a8d1292
Law World 434
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

I just found out that INTERNATIONAL CORPORATION SERVICES LTD. (ICS) acts as registered agent for our largest competitor. Considering that ICS has all our financial and other info, this is a serious breach of trust and they need to be terminated ASAP for this violation. How fast can I make this happen? Reply here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual1/1Pass
fireworks models Kimi K2dual1/1Pass
Gemini 3 Flashdual1/1Pass
Gemini 3.1 Produal1/1Pass
GPT-5.4dual1/1Pass
GPT-5.4 minidual1/1Pass
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that ICS can be terminated upon 3 months notice

    Pass

    Evidence: TEXT_RESPONSE says “Ordinary termination: give at least 3 months’ notice” and quotes that the Company may terminate “by giving not less than three (3) months' notice to ICSL.” Assessment: The criterion requires stating that ICS can be terminated upon 3 months notice; pass because the response clearly states this.