APEX-Agents · Management Consulting
World 127 TJ Task 4.0
APEX-Agents task World 127 TJ Task 4.0 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Let's check how a -2/+2 percentage points (pp) in annual gross margin for all component families affects Helios' total gross profit across the three scenarios. Assume base revenue stays constant, so any change in margin directly impacts gross profit and COGS. Using the file 5 year Business Case model, calculate the total gross profit in € under both -2 and +2 pp assumptions and give the results by scenario. Print your reply here, and round all final figures to two decimal places.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 nano | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 4/6 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/6 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the 2026 - 2030 total gross profit (€) under the -2pp margin assumption for the exit scenario is €61,483,734,396.99
States that the 2026 - 2030 total gross profit (€) under the -2pp margin assumption for the retain scenario is €55,522,462,356.13
States that the 2026 - 2030 total gross profit (€) under the -2pp margin assumption for the transition scenario is €67,073,681,310.24
States that the 2026 - 2030 total gross profit (€) under the +2pp margin assumption for the exit scenario is €73,205,554,354.82
States that the 2026 - 2030 total gross profit (€) under the +2pp margin assumption for the retain scenario is €66,169,265,213.81
States that the 2026 - 2030 total gross profit (€) under the +2pp margin assumption for the transition scenario is €79,868,960,058.25