APEX-Agents · Law
Law_World_419_WA_02
APEX-Agents task Law_World_419_WA_02 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Draft a pre-litigation legal memorandum that addresses CJ's status, financial exposure, and potential defenses under the Oil Protection Act of 1990. Create a new docx file, containing your memo.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 | dual | 6/9 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 6/9 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/9 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/9 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/9 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/9 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that CJ is a "responsible party" under 33 U.S.C. § 2701(32) based on charterer/operator status
States that being a responsible party triggers strict liability for removal costs and damages under § 2702(a)
States that § 2704(a)(1) establishes a liability limit of $2,500 per gross ton
States that § 2704(a)(1) includes a statutory liability minimum of $21,521,000
States that the gross ton liability limit is $74,617,500
States that the gross ton liability is greater than $21,521,000
States that CJ's liability cap is $74,617,500
States that the third-party sole negligence under Section 2703(a)(3) is the strongest defense
States that the third-party defense requires the defendant to prove that it had no contractual relationship with a third party affecting vessel operation