Raycaster/ Eval

APEX-Agents

GPT-5.4 on World416_TK_04

1/2Fail
Domain
Law
Category
AI Agents for Tariff and Trade Law Analysis
Harness
dual

Grader rubric

Criteria verdict

  1. States that a tariff-driven mid-term price-increase request is an unenforceable modification under Master Supply Agreement Template 1

  2. States that a tariff-driven mid-term price-increase request is an unenforceable modification under Master Supply Agreement Template 4

Prompt excerpt

Task context

Review the two supply agreement templates, Master Supply Agreement Template 1.docx and Master Supply Agreement Template 4.pdf, along with the attached files (UCC §2-209 and Restatement (Second) of Contracts §89) to determine whether the supplier’s tariff-based request for a mid-term price increase would be a valid modification. Reply to me here with your assessment.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.