Raycaster/ Eval

APEX-Agents · Law

World418-TK-01

Best published2/2Pass

APEX-Agents task World418-TK-01 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Maritime and Environmental LiabilityLaw World 418Dual harnessGrader: rubric
task_3413464bd2b14df6bd2ee15c36d3abf1
Law World 418
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Can you please assess whether or not the new LNG carries built by Nakamura Heavy Industries can be used in Jones Act Trade? Additionally, BlueLNG JV purchased another LNG vessel and asks whether it can be used in Jones Act Trade as well. It was built in 1992 in France. Please give me your reply right back here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3 Flashdual2/2Pass
GPT-5.4 minidual2/2Pass
fireworks models Kimi K2dual1/2Fail
Gemini 3.1 Produal1/2Fail
GPT-5.4dual1/2Fail
GPT-5.4 nanodual1/2Fail
GPT-5.5dual1/2Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States No, the LNG carriers built by Nakamura Heavy Industries cannot be used in Jones Act Trade

  2. States Yes, the LNG carrier built in 1992 in France can be used in Jones Act Trade solely between the U.S. and Puerto Rico