APEX-Agents
gpt-5.5 on World 128 - NK - Task 1
Grader rubric
Criteria verdict
States Waymo RMS in Los Angeles is 1.00
FailStates Cruise RMS in Los Angeles is 0.75
FailStates Tesla RMS in Los Angeles is 0.50
FailStates Waymo RMS in San Francisco is 1.00
FailStates Cruise RMS in San Francisco is 1.00
FailStates Tesla RMS in San Francisco is 0.67
FailStates Waymo RMS in Sacramento is 1.00
FailStates Cruise RMS in Sacramento is 0.50
FailStates that AmensaDrive operates in one out of the three provided cities
Pass
Prompt excerpt
Task context
Let's evaluate the new market intelligence we've received to figure out the RMS for competitors in each city. Tell me how many of these cities AmensaDrive operates in in 2026. Format answers to two decimal points. Provide your response right here.
Response trace
Agent response, tools, files, and edits
On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.
Why Eval exists · why Workspace exists
Public evidence and cloud agents are the same harness.
Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.