APEX-Agents · Management Consulting
World 127_HLV_Task 03
APEX-Agents task World 127_HLV_Task 03 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We want to understand the most important investment areas for pureplay EV respondents. The previous file contained incomplete information, so please use the newly attached updated file. Identify the #1 and #2 most important investment areas for pureplay EV respondents. Using only respondents who selected those two areas as their #1 and #2 priorities, calculate the average score for: (1) Relevance of legacy suppliers and (2) Level of redesign required. Then compare these average scores to the averages calculated using only Auto Parts respondents. Round all final scores to two decimal places and output the results to me here as a short message.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 4/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that Advanced materials is one of the two most important areas for investment
States that Manufacturing automation is is one of the two most important areas for investment
States that the average score for relevance of legacy suppliers for Pureplay EV respondents who selected at least one of the top two important areas for investments is 2.20
States that the average score for Pureplay EV respondents who selected at least one of the top two important areas for investments level of redesign required is 3.20
States that the average score for all Autoparts respondents for relevance of legacy suppliers is 2.57
States that the average score for all Autoparts respondents for level of redesign required is 2.79