Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 mini · dual

Task 14

6/9Fail

GPT-5.4 mini on APEX-Agents: Task 14 (dual harness). Browse score, rubric, and public trace.

6/9 · Fail
Management Consulting
AI Agents for SaaS Due Diligence
Management Consulting World 129

Grader rubric

Criteria verdict

  1. States the average adoption rate of Business is 30.0%

  2. States the average adoption rate of Growth is 42.1%

  3. States the average adoption rate of Enterprise is 44.9%

  4. States the average monthly usage of Business is 19.1 hours per month

  5. States the average monthly usage of Growth is 50.3 hours per month

  6. States the average monthly usage of Enterprise is 51.1 hours per month

  7. States the average retention impact of Business is 1.46

  8. States the average retention impact of Growth is 1.59

  9. States the average retention impact of Enterprise is 1.50

Prompt excerpt

Task context

Can you use the feature usage file and identify the average adoption rate percentage, average monthly usage, and average retention impact score for each tier except Team? Print the output for me here.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace