Raycaster / evalsBack to AI Agents for Privacy and GDPR Compliance

APEX-Agents · Law

World419-TK-01

4/6Fail

APEX-Agents task World419-TK-01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Privacy and GDPR ComplianceLaw World 419Dual harnessGrader: rubric
Task IDtask_edcdb5ede7d64fd5a79010c3861aa468
WorldLaw World 419
Expected outputmessage_in_console
Published runs5 models · dual config

Task prompt

What the agent was asked to do

Can the Terminal Operator arrest the vessel (M/V Red Room) in rem under Rule C to secure cleanup costs arising from the spill? Please provide a few paragraphs to me in here, explaining your answer based on maritime law.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
fireworks models Kimi K2dual4/6FailShare pagePublic trace
Gemini 3.1 Produal2/6FailShare pagePublic trace
GPT-5.4dual3/6FailShare pagePublic trace
GPT-5.4 minidual2/6FailShare pagePublic trace
GPT-5.4 nanodual2/6FailShare pagePublic trace

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the Terminal Operator cannot arrest the vessel in rem under Rule C

  2. States that arresting a vessel in rem under Rule C requires the claimant to establish a maritime lien against the vessel

  3. States all of the following ways to establish an in rem claim under Rule C: (1) by a tort action demonstrating the vessel has damaged the claimant's property; and (2) by a breach of contract action that gives rise to a maritime lien

  4. States that the Terminal Operator has not suffered damages to its property

  5. States that the Terminal Services Agreement is the contract that governs any contractual relationship between the parties

  6. States that the Terminal Services Agreement cannot give rise to a maritime lien