APEX-Agents · Law
World 419_UM_02
APEX-Agents task World 419_UM_02 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
I need your help determining how much will be covered by MARINEX under our current insurance policies, between the cleanup costs incurred after the incident and Jack Sparrow's claim. Please see if Captain Dee's imposed penalty of $128,375 will also be covered under both our policies. Reply back with your findings. Thank you!
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/2 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/2 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/2 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/2 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/2 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that Yes, the imposed penalty of $128,375 will be covered under the policies
States that the total amount payable by MARINEX to Cooper/Jeffries is payable under both of these policies: (1) the Protection and Indemnity Insurance Policy and (2) the Marine Pollution Legal Liability Insurance Policy