Raycaster/ Eval

APEX-Agents · Management Consulting

World 127_HLV_Task 07

Best published0/7Fail

APEX-Agents task World 127_HLV_Task 07 in AI Agents for Automotive EV Transition Strategy. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Automotive EV Transition StrategyManagement Consulting World 127Dual harnessGrader: rubric
task_becc9688490441baa6d7c4788c21171a
Management Consulting World 127
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

We are making changes to the case model to highlight a downside scenario where China's embargo on critical minerals reduces the components' margins by 50% if they are used for Hybrid and/or EV. The other components' margins will decrease by 20%. With this in mind, return back to me: 1) Gross Profit (and gross margin) for Retain 2) Gross Profit (and gross margin) for Transition 3) Gross Profit (and gross margin) for Exit If the Gross Profit for Transition declines by more than 40%, then note that Helios is significantly exposed to geopolitical risk in regard to critical minerals. Show the gross profit as a whole number in EUR. Write your answer straight here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal0/7Fail
GPT-5.4dual0/7Fail
GPT-5.4 minidual0/7Fail
GPT-5.4 nanodual0/7Fail
GPT-5.5dual0/7Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that the Gross Profit for Retain is 36,483,223,954

  2. States that the Gross Profit for Transition is 43,874,881,658

  3. States that the Gross Profit for Exit is 39,960,173,941

  4. States that the Gross Profit percentage for Retain is 13.9%

  5. States that the Gross Profit percentage for Transition is 13.9%

  6. States that the Gross Profit percentage for Exit is 13.8%

  7. States Gross Profit for Transition in this new downside scenario is lower than the original scenario by 39.3%