APEX-Agents · Management Consulting
W127_AH_Task6
APEX-Agents task W127_AH_Task6 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Pull the values for each brand's SKU share. Give them as a percentage of total SKUs, and matching the platform/application and brand name. Round percentages to two decimals. Output your results as a reply here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 8/8 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 8/8 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 8/8 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 7/8 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 7/8 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 7/8 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the SKU share for BYD is 12.24%
States that the SKU share for Ford is 10.64%
States that the SKU share for GM is 10.24%
States that the SKU share for Hyundai is 11.68%
States that the SKU share for Volkswagen is 21.64%
States that the SKU share for for Stellantis is 12.04%
States that the SKU share for Toyota is 10.60%
States that the SKU share for Volvo is 10.92%