APEX-Agents · Management Consulting
SP Task 02 World 129
APEX-Agents task SP Task 02 World 129 in AI Agents for SaaS Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Use the baseline seat utilization data against the attached 2025 strategic targets for the following two metrics. 1) What is the Seat Purchased Surplus (Actual Seats minus Target Seats) for the Medium utilization band in the Enterprise tier? 2) What is the difference in percentage points between the Target High (>80%) share for the Business tier and the Actual share? Please provide both answers as a reply here, rounded to the nearest whole number.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 1/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the Seat Purchased Surplus for the Medium utilization band in the Enterprise tier, comparing baseline utilization to 2025 targets, is 47,487
States that the difference between the 2025 Target High (>80%) share for the Business tier and the baseline Actual share is 23 percentage points