Raycaster/ Eval

APEX-Agents

Gemini 3.1 Pro on Task acg14a6c

6/6Pass
Domain
Law
Category
AI Agents for Privacy and GDPR Compliance
Harness
dual

Grader rubric

Criteria verdict

  1. States that section 8.4 of the MSA does not protect CrowdStrike from their own mistakes

  2. States that Section 10.1 of the MSA limits liability for all of the following: (1) lost revenue and (2) lost data damages

  3. States that the customer's email does not meet the contractual delivery requirements in Section 14.7 of the MSA

  4. States that CrowdStrike is liable under section 8.4 of the MSA

  5. States that CrowdStrike is not liable under Section 10.1 of the MSA

  6. States that CrowdStrike is not liable under Section 14.7 of the MSA

Prompt excerpt

Task context

Can you review Sections 8.4, 9.1, 9.3,10.1,14.7 in our MSA, against the below outage scenario? A faulty update causes endpoint failures. The customer sends a breach notice by email to a support inbox, seeks lost revenue and lost data costs and asserts that CrowdStrike must indemnify all losses. For each of the clauses that applies to the facts above, state whether CrowdStrike is liable or not, and provide a one-sentence reason for the conclusion. Put it in a new doc file you create.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Eval publishes runs. Workspace runs agents on files.

Eval publishes task details, available traces, output files, and rubric results.Workspace is Raycaster’s product for running agents on files.