Raycaster/ Eval

APEX-Agents

gpt-5.5 on World419_DM_01

0/2Fail
Domain
Law
Category
AI Agents for Maritime and Environmental Liability
Harness
dual

Grader rubric

Criteria verdict

  1. States that under 33 U.S.C. § 2704(a)(4), the statutory maximum potential liability is limited to the lesser of the statutory cap or the actual claims

    Fail
  2. States that the maximum potential liability for Black Lodge Petroleum Logistics LLC under the Oil Pollution Act is $144,140,000

    Fail

Prompt excerpt

Task context

Can you tell me the maximum total potential liability for Black Lodge Petroleum Logistics LLC under the Oil Pollution Act? Reply to me, and tell me the relevant section that applies and what it says.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.