APEX-Agents · Management Consulting
World127_AK_Task01
APEX-Agents task World127_AK_Task01 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
After reviewing our analysis, the client has a few more requests for us. Recall we had shown scenarios in which the company discontinues SKUs which account for 5%, 7.5%, and 10% of gross profit. We want to redo the same exercise but limit the gross profit reduction to 3%. In this scenario, we want to maximize the number of ICE SKUs discontinued. We also want to identify which platforms have the largest percentage of SKUs discontinued, so the client can prioritize discussions with those customers. Provide your response to me right here. Dollar value final answers and percentage final answers should be rounded to two decimal places.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 5/8 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 5/8 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 4/8 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 4/8 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 3/8 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/8 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that Helios's total LTM 2025 gross profit is €482,962,639.80
States that the number of Helios's SKUs that should be discontinued in the 3% gross profit reduction scenario is 336
States that one of the three platforms that have the highest percentage of SKUs discontinued in the 3% gross profit reduction scenario is MLB EVO
States that one of the three platforms that have the highest percentage of SKUs discontinued in the 3% gross profit reduction scenario is TNGA
States that one of the three platforms that have the highest percentage of SKUs discontinued in the 3% gross profit reduction scenario is GM Ultium
States that the percentage of MLB EVO SKUs discontinued in the 3% gross profit reduction scenario is 12.62%
States that the percentage of TNGA SKUs discontinued in the 3% gross profit reduction scenario is 10.89%
States that the percentage of GM Ultium SKUs discontinued in the 3% gross profit reduction scenario is 10.75%