Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.5 · dual

SP Task 02 World 129

1/2Fail

GPT-5.5 on APEX-Agents: SP Task 02 World 129 (dual harness). Browse score, rubric, and public trace.

1/2 · Fail
Management Consulting
AI Agents for SaaS Due Diligence
Management Consulting World 129

Grader rubric

Criteria verdict

  1. States that the Seat Purchased Surplus for the Medium utilization band in the Enterprise tier, comparing baseline utilization to 2025 targets, is 47,487

    Fail
  2. States that the difference between the 2025 Target High (>80%) share for the Business tier and the baseline Actual share is 23 percentage points

    Pass

Prompt excerpt

Task context

Use the baseline seat utilization data against the attached 2025 strategic targets for the following two metrics. 1) What is the Seat Purchased Surplus (Actual Seats minus Target Seats) for the Medium utilization band in the Enterprise tier? 2) What is the difference in percentage points between the Target High (>80%) share for the Business tier and the Actual share? Please provide both answers as a reply here, rounded to the nearest whole number.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace