APEX-Agents · Law
World419-TK-01
APEX-Agents task World419-TK-01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Can the Terminal Operator arrest the vessel (M/V Red Room) in rem under Rule C to secure cleanup costs arising from the spill? Please provide a few paragraphs to me in here, explaining your answer based on maritime law.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 3/6 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/6 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/6 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the Terminal Operator cannot arrest the vessel in rem under Rule C
States that arresting a vessel in rem under Rule C requires the claimant to establish a maritime lien against the vessel
States all of the following ways to establish an in rem claim under Rule C: (1) by a tort action demonstrating the vessel has damaged the claimant's property; and (2) by a breach of contract action that gives rise to a maritime lien
States that the Terminal Operator has not suffered damages to its property
States that the Terminal Services Agreement is the contract that governs any contractual relationship between the parties
States that the Terminal Services Agreement cannot give rise to a maritime lien