Raycaster/ Eval

OfficeQA

gpt-5.4 on UID0220

0/1Fail
Domain
OfficeQA
Category
AI Agents for Government Financial Document Q&A
Harness
dual

Prompt excerpt

Task context

What is the absolute percent difference between the total federal expenditures reported in February 1938 and January 1939, rounded to the nearest tenths place in millions of dollars?

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.