APEX-Agents · Law
World419_AH_02
APEX-Agents task World419_AH_02 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
The containment and remediation efforts for the crude oil spill were successful, and our total liability was $1.5 million, which we claimed under our insurance. 6 months after the spill, we were contacted by a fish nursery downstream of the spill. They claim that the spill interfered with their operations, and are seeking $150,000 in damages. Can we claim this under our insurance? Tell me the answer in here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 0/1 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 0/1 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/1 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States No, the $150,000 loss cannot be claimed under the policy