APEX-Agents · Management Consulting
World 129_CY_Task 2
APEX-Agents task World 129_CY_Task 2 in AI Agents for Divestiture and Spin-Off Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Refer to the latest (v1.0) customer segmentation data and the final pricing model. Calculate the % change of Customer Segmentation expected revenue (use target customers and average ARR for the pricing) relative to Configuration A expected revenue (use target customers and effective pricing) for each segment. Account for churn in both scenarios based on each scenario's respective data source. Reply with your results here, with final numbers rounded to the nearest 0.01%.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 0/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the percentage change of Customer Segmentation expected revenue relative to Configuration A expected revenue for SMB is 51.82%
States that the percentage change of Customer Segmentation expected revenue relative to Configuration A expected revenue for Mid-Market is -49.17%
States that the percentage change of Customer Segmentation expected revenue relative to Configuration A expected revenue for Enterprise is -91.40%