APEX-Agents · Management Consulting
Word_129_PJ_01
APEX-Agents task Word_129_PJ_01 in AI Agents for SaaS Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
I want to forecast total annual revenue for ServiceNow based on the competition's price benchmarking information available to us. For this analysis, calculate revenue for each of their tier/plan (like ITIL User (Base), ITOM Module etc.) based on the attached information. Optimal price multiplier refers to the percentage points above the minimum price point where the tier/plan will be priced. Report total forecast revenue in $m, rounded to one decimal place. Print your response here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 1/1 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the total forecast annual revenue for ServiceNow is $1,438.2 million