Raycaster/ Eval

APEX-Agents · Law

World419_DM_01

Best published1/2Fail

APEX-Agents task World419_DM_01 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Maritime and Environmental LiabilityLaw World 419Dual harnessGrader: rubric
task_f868a55db35a4add998e12e09056b96a
Law World 419
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Can you tell me the maximum total potential liability for Black Lodge Petroleum Logistics LLC under the Oil Pollution Act? Reply to me, and tell me the relevant section that applies and what it says.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
fireworks models Kimi K2dual1/2Fail
Gemini 3 Flashdual0/2Fail
Gemini 3.1 Produal0/2Fail
GPT-5.4dual0/2Fail
GPT-5.4 minidual0/2Fail
GPT-5.4 nanodual0/2Fail
GPT-5.5dual0/2Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that under 33 U.S.C. § 2704(a)(4), the statutory maximum potential liability is limited to the lesser of the statutory cap or the actual claims

  2. States that the maximum potential liability for Black Lodge Petroleum Logistics LLC under the Oil Pollution Act is $144,140,000