Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 · dual

World416_TK_04

1/2Fail

GPT-5.4 on APEX-Agents: World416_TK_04 (dual harness). Browse score, rubric, and public trace.

1/2 · Fail
Law
AI Agents for Tariff and Trade Law Analysis
Law World 416

Grader rubric

Criteria verdict

  1. States that a tariff-driven mid-term price-increase request is an unenforceable modification under Master Supply Agreement Template 1

  2. States that a tariff-driven mid-term price-increase request is an unenforceable modification under Master Supply Agreement Template 4

Prompt excerpt

Task context

Review the two supply agreement templates, Master Supply Agreement Template 1.docx and Master Supply Agreement Template 4.pdf, along with the attached files (UCC §2-209 and Restatement (Second) of Contracts §89) to determine whether the supplier’s tariff-based request for a mid-term price increase would be a valid modification. Reply to me here with your assessment.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace