Raycaster/ Eval

APEX-Agents

Kimi K2 on Task yhzc9d1a

5/5Pass
Domain
Law
Category
AI Agents for SEC Disclosure Analysis
Harness
dual

Grader rubric

Criteria verdict

  1. States that Michael Lawson made a Class A Stock Purchase on 11/30/2023

  2. States that Larry Stone made a Class A Stock Purchase on 4/3/2024

  3. States that Geralt Tribeard made a Class A Stock Purchase on 7/28/2024

  4. States that Susan Willow made a Class A Stock Purchase on 2/7/2024

  5. States that Rayland Givens made a Class A Stock Purchase on 7/5/2024

Prompt excerpt

Task context

CrowdStrike sent the attached list of historic stock transactions (note the document lists transactions for both Class A and B stocks). We need to determine if any of these people would be a part of the class in the Plymouth County lawsuit, assuming no opt-outs. Look for the class requirements and the attached list of transactions, identify which individuals from the upload purchased Class A stock, and which of those did so during the Class Period to qualify for the class. Make a new sheet and list their names and each transaction for which the individual qualifies.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Eval publishes runs. Workspace runs agents on files.

Eval publishes task details, available traces, output files, and rubric results.Workspace is Raycaster’s product for running agents on files.