APEX-Agents · Management Consulting
W127_AH_Task4
APEX-Agents task W127_AH_Task4 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Use the financial model with the new numbers from the finance team (attached) to calculate the 5 year values for: (1) Revenue, (2) COGS, and (3) Gross Profit. Round all final numbers to two decimals (i.e., show me the dollars and cents). Print the numbers you've calculated back to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 0/3 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/3 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/3 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/3 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the five-year revenue value for non-exited scenarios is 731,107,382,989.08
States that the five-year COGS value for non-exited scenarios is 562,615,950,451.56
States that the five-year gross profit value for non-exited scenarios is 168,491,432,537.51