Raycaster/ Eval

APEX-Agents · Law

LawWorld417_ANB_04

Best published1/1Pass

APEX-Agents task LawWorld417_ANB_04 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 417Dual harnessGrader: rubric
task_075c6f8ffb1548508e94e67e4ba04bbb
Law World 417
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Chasing Streams fired its entire facilities department and Head of Production before ParaZon acquired it. Sarah Rodriguez filed a Complaint on July 4, 2025 against ParaZon claiming not enough notice was given to her, and damages from breach of her employment contract. How much is ParaZon liable to Sarah in damages for insufficient notice under the California WARN Act? Give me your reply back here as a message.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3 Flashdual1/1Pass
Gemini 3.1 Produal1/1Pass
GPT-5.4dual1/1Pass
GPT-5.4 minidual1/1Pass
GPT-5.5dual1/1Pass
fireworks models Kimi K2dual0/1Fail
GPT-5.4 nanodual0/1Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that the amount that ParaZon is liable to Sarah Rodriguez under the WARN Act is $0