Raycaster/ Eval

APEX-Agents

GPT-5.4 on Task yhzc9d1a

5/5Pass
Domain
Law
Category
AI Agents for SEC Disclosure Analysis
Harness
dual

Grader rubric

Criteria verdict

  1. States that Michael Lawson made a Class A Stock Purchase on 11/30/2023

  2. States that Larry Stone made a Class A Stock Purchase on 4/3/2024

  3. States that Geralt Tribeard made a Class A Stock Purchase on 7/28/2024

  4. States that Susan Willow made a Class A Stock Purchase on 2/7/2024

  5. States that Rayland Givens made a Class A Stock Purchase on 7/5/2024

Prompt excerpt

Task context

CrowdStrike sent the attached list of historic stock transactions (note the document lists transactions for both Class A and B stocks). We need to determine if any of these people would be a part of the class in the Plymouth County lawsuit, assuming no opt-outs. Look for the class requirements and the attached list of transactions, identify which individuals from the upload purchased Class A stock, and which of those did so during the Class Period to qualify for the class. Make a new sheet and list their names and each transaction for which the individual qualifies.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.