APEX-Agents · Management Consulting
World127_AM_Task03
APEX-Agents task World127_AM_Task03 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We have ten expert call summaries from 2022 plus our latest 2025 expert synthesis file, and we want to see how typical EV unit prices have moved for two key families. Can you read the call summaries to pull out the euro unit price points for EV in 2022 for “Vehicle electronics sensors and controls” and “EV charging and onboard power”, use the synthesis file to get the 2025 EV prices for the same families, then compute the average price in each year and the percent change from 2022 to 2025 for each family? Print your reply back to me here with everything.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 4/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the value for Vehicle electronics sensors and controls 2022 AVG EUR is 284.8
States that the value for Vehicle electronics sensors and controls in 2025 AVG EUR is 311.5
States that the percentage change of AVG EUR between 2025 and 2022 for Vehicle electronics sensors and controls is 9.4%
States that the value for EV charging and onboard power in 2022 AVG is EUR 475.6
States that the value for EV charging and onboard power in 2025 AVG is EUR 584.0
States that the percentage change of AVG EUR between 2025 and 2022 for EV charging and onboard power is 22.8 percent