Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 · dual

Task jhp9ccb4

0/3Fail

GPT-5.4 on APEX-Agents: Task jhp9ccb4 (dual harness). Browse score, rubric, and public trace.

0/3 · Fail
Law
AI Agents for SEC Disclosure Analysis
Law World 415

Grader rubric

Criteria verdict

  1. States that CrowdStrike bears the RRC risk under one of the following: "CrowdStrike MSA.pdf"; "CrowdStrike MSA.docx"; and the standard MSA

  2. States that there is no provision in the MSA that explicitly allocates the RRC risk to the customer

  3. States that there is no provision in the MSA that addresses content deployment

Prompt excerpt

Task context

A real-time Rapid Response Content (RRC) update is automatically delivered and it causes performance degradation in a customer’s environment. The customer did not stage deployments, had no rollback plan, and used the system in a critical operational setting. Can you review the board memo, along with Crowdstrike's standard and proposed MSA and let me know if CrowdStrike bears the risk for service interruption caused by the RRC? Explain your response and tell me what documents inform your assessment. Write our your findings to me here. Thanks!

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace