Raycaster/ Eval

APEX-Agents · Management Consulting

World 127 TJ Task 2.0

Best published0/4Fail

APEX-Agents task World 127 TJ Task 2.0 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Automotive EV Transition StrategyManagement Consulting World 127Dual harnessGrader: rubric
task_8e592b2a3061410ebafea3183c960ff9
Management Consulting World 127
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Let's model the impact of the price war in the EV charging space. There is an 8% reduction in the ASP for 'on vehicle charging hardware' across all three scenarios. We need to recalculate the revenue (€) in the core calculation spreadsheet and then show how much component-level and scenario-wise revenue (€) the client could lose from 2026 to 2030 due to this reduction. This 8% reduction occurs at the ASP/year level, and does not compound year-over-year. This occurs in addition to any other yearly price changes. Output your results right here as a short message. Give values in the complete dollars and cents.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal0/4Fail
GPT-5.4dual0/4Fail
GPT-5.4 minidual0/4Fail
GPT-5.4 nanodual0/4Fail
GPT-5.5dual0/4Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that the total 5-year revenue lost in the 'on vehicle charging hardware' component family is €5,148,773,894.47

  2. States that the total 5-year revenue loss in the exit scenario including all 14 component families is €1,866,336,376.30

  3. States that the total 5-year revenue loss in the retain scenario including all 14 component families is €1,421,272,290.49

  4. States that the total 5-year revenue loss in the transition scenario (including all 14 component families) is €1,861,165,227.68