Raycaster / evalsBack to AI Agents for Privacy and GDPR Compliance

APEX-Agents · Law

LawWorld417_ANB_04

1/1Pass

APEX-Agents task LawWorld417_ANB_04 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 417Dual harnessGrader: rubric
task_075c6f8ffb1548508e94e67e4ba04bbb
Law World 417
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Chasing Streams fired its entire facilities department and Head of Production before ParaZon acquired it. Sarah Rodriguez filed a Complaint on July 4, 2025 against ParaZon claiming not enough notice was given to her, and damages from breach of her employment contract. How much is ParaZon liable to Sarah in damages for insufficient notice under the California WARN Act? Give me your reply back here as a message.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual1/1Pass
fireworks models Kimi K2dual0/1Fail
Gemini 3 Flashdual1/1Pass
Gemini 3.1 Produal1/1Pass
GPT-5.4dual1/1Pass
GPT-5.4 minidual1/1Pass
GPT-5.4 nanodual0/1Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the amount that ParaZon is liable to Sarah Rodriguez under the WARN Act is $0

    Pass

    Evidence: The response states, “ParaZon’s California WARN Act damages exposure to Sarah Rodriguez is $0” and concludes “ParaZon’s liability to Sarah for insufficient notice under California WARN is $0.” Assessment: Criterion requires stating that ParaZon is liable to Sarah Rodriguez under the WARN Act for $0; pass because the response clearly states this amount.