Raycaster/ Eval

APEX-Agents

GPT-5.4 on World 129_CY_Task 5

0/1Fail
Domain
Management Consulting
Category
AI Agents for Legal Contract Review
Harness
dual

Grader rubric

Criteria verdict

  1. States that the average seat change by Brightpath customers across all contract renewals with seat changes is -19.02 seats

Prompt excerpt

Task context

Using the latest renewal / churn data (v1.0) and pricing log, identify the average seat changes (increase or decrease) by Brightpath customers from every renewal with seat changes. When doing the calculation, change v4.2 pricing effective start date year to 2023 and make use of monthly price per user to calculate the seat changes. Present your result, printing it right in here to the nearest 0.01.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.