APEX-Agents · Law
World419_DM_02
APEX-Agents task World419_DM_02 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Evaluate the maximum total potential liability for Star Tankers International Ltd. compared to Cooper/Jeffries Energy Corporation under the Oil Pollution Act for the incident with the M/V Red Room. Draft a message to me here, stating which entity has a greater liability if found to be the sole responsible party for the incident with the M/V Red Room. Calculate and include the potential maximum liability for each party. Give the values in 100s. Use the BLPL Claim Summary, the relevant legal authority, and the Hull and Machinery Survey for your analysis.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 1/3 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 1/3 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 1/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the maximum potential liability for Star Tankers International Ltd. under the Oil Pollution Act is $56,709,300
States that the maximum potential liability for Cooper/Jeffries Energy Corporation under the Oil Pollution Act is $56,709,300
States that neither Star Tankers International Ltd. nor Cooper/Jeffries Energy Corporation have greater potential liability under the Oil Pollution Act as their maximum liability is equal