APEX-Agents · Law
World419_el_01
APEX-Agents task World419_el_01 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Review Articles 2-6 and 9-13 of the Charter Party Agreement and let me know which ones could be used to create joint liability with or shift liability to the Owner for any oil spills? Provide a yes/no assessment for each Article. Print your response back here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 8/10 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 8/10 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 8/10 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 8/10 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 8/10 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 6/10 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 6/10 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States yes for Article 2
States no for Article 3
States no for Article 4
States no for Article 5
States yes for Article 6
States yes for Article 9
States no for Article 10
States no for Article 11
States no for Article 12
States no for Article 13