Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · fireworks models Kimi K2 · dual

Task acg14a6c

4/6Fail

fireworks models Kimi K2 on APEX-Agents: Task acg14a6c (dual harness). Browse score, rubric, and public trace.

4/6 · Fail
Law
AI Agents for Privacy and GDPR Compliance
Law World 415

Grader rubric

Criteria verdict

  1. States that section 8.4 of the MSA does not protect CrowdStrike from their own mistakes

  2. States that Section 10.1 of the MSA limits liability for all of the following: (1) lost revenue and (2) lost data damages

  3. States that the customer's email does not meet the contractual delivery requirements in Section 14.7 of the MSA

  4. States that CrowdStrike is liable under section 8.4 of the MSA

  5. States that CrowdStrike is not liable under Section 10.1 of the MSA

  6. States that CrowdStrike is not liable under Section 14.7 of the MSA

Prompt excerpt

Task context

Can you review Sections 8.4, 9.1, 9.3,10.1,14.7 in our MSA, against the below outage scenario? A faulty update causes endpoint failures. The customer sends a breach notice by email to a support inbox, seeks lost revenue and lost data costs and asserts that CrowdStrike must indemnify all losses. For each of the clauses that applies to the facts above, state whether CrowdStrike is liable or not, and provide a one-sentence reason for the conclusion. Put it in a new doc file you create.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace