Raycaster/ Eval

APEX-Agents

gpt-5.5 on Task iv36a08a

1/7Fail
Domain
Law
Category
AI Agents for SEC Disclosure Analysis
Harness
dual

Grader rubric

Criteria verdict

  1. States that Count 1 is Not Covered

    Fail
  2. States that Count 2 is Not Covered

    Fail
  3. States that Count 3 is Not Covered

    Fail
  4. States that Count 4 is Not Covered

    Fail
  5. States that Count 5 is Covered

    Pass
  6. States that Count 6 is Not Covered

    Fail
  7. States that Count 7 is Not Covered

    Fail

Prompt excerpt

Task context

Analyze whether Counts 1-7 of Delta's Complaint against CrowdStrike fall within the limitation of liability clause in Section 10.1 of CrowdStrike's standard MSA, indicating "Covered" or "Not Covered" for each count. Reply back to me here with your assessments.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Eval publishes runs. Workspace runs agents on files.

Eval publishes task details, available traces, output files, and rubric results.Workspace is Raycaster’s product for running agents on files.