APEX-Agents
GPT-5.4 on Task acg14a6c
Grader rubric
Criteria verdict
States that section 8.4 of the MSA does not protect CrowdStrike from their own mistakes
States that Section 10.1 of the MSA limits liability for all of the following: (1) lost revenue and (2) lost data damages
States that the customer's email does not meet the contractual delivery requirements in Section 14.7 of the MSA
States that CrowdStrike is liable under section 8.4 of the MSA
States that CrowdStrike is not liable under Section 10.1 of the MSA
States that CrowdStrike is not liable under Section 14.7 of the MSA
Prompt excerpt
Task context
Can you review Sections 8.4, 9.1, 9.3,10.1,14.7 in our MSA, against the below outage scenario? A faulty update causes endpoint failures. The customer sends a breach notice by email to a support inbox, seeks lost revenue and lost data costs and asserts that CrowdStrike must indemnify all losses. For each of the clauses that applies to the facts above, state whether CrowdStrike is liable or not, and provide a one-sentence reason for the conclusion. Put it in a new doc file you create.
Response trace
Agent response, tools, files, and edits
On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.
Why Eval exists · why Workspace exists
Public evidence and cloud agents are the same harness.
Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.