APEX-Agents · Management Consulting
World 127_HLV_Task 01
APEX-Agents task World 127_HLV_Task 01 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Use the Helios customer survey to calculate average NPS scores for Pureplay EVs and EV/ICE. - If the average is 2 or below, they are promoters. They are passives if they are between 2 and 3, and detractors are above 3. - NPS is defined as: (% Promoters - % Detractors) x 100. Based on these values: If the overall NPS score is above 20, state that Legacy manufacturers have a competitive advantage. If it is below 20, state that Legacy manufacturers do not have a competitive advantage. Make sure to note the count of promoters, detractors, and passives. Print your answers here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 | dual | 2/7 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/7 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/7 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 1/7 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/7 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the number of Promoters is 5
States the number of Passives is 24
States the number of Detractors is 21
States that Total NPS is -32
States that NPS for Pureplay EVs is -83
States that NPS for EV/ICE is -27
States that legacy manufacturers do not have a competitive advantage