APEX-Agents · Law
World419_UM_04
APEX-Agents task World419_UM_04 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
The Owner incurred the following fees after the M/V Red Room incident: - $75,008,767 in federal response costs and natural resource damages - $4,988,044 in third party economic loss damages - $187,098 in PR and media response costs - $9,854,098 to repair and repaint the M/V Red Room - $5,567,008 in legal costs Cooper/Jeffries recovered $67,765,009 from Black Lodge Petroleum Logistics LLC ("BLPL") in relation to the incident. Reply to me here, stating very briefly the Settlement Payment Amount owed by Cooper/Jeffries (i.e., the minimum).
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 1/1 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 1/1 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/1 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the Settlement Payment Amount owed by Cooper/Jeffries is $5,000,000