Raycaster/ Eval

APEX-Agents · Management Consulting

World127_AK_Task03

Best published10/10Pass

APEX-Agents task World127_AK_Task03 in AI Agents for Commercial Contract Risk. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Commercial Contract RiskManagement Consulting World 127Dual harnessGrader: rubric
task_799bb0f9ca444c7d9c2fff7aaa4885a9
Management Consulting World 127
message_in_console
6 models · dual config

Task prompt

What the agent was asked to do

Based on the client’s SKU data, calculate the weighted average gross margin for each platform. Then determine the percentage price increase required for SKUs on the lowest-margin platform to raise their margin to match the weighted average gross margin of all other platforms combined. Reply to me with the analysis.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3 Flashdual10/10Pass
Gemini 3.1 Produal10/10Pass
GPT-5.4 minidual10/10Pass
GPT-5.4 nanodual10/10Pass
GPT-5.5dual9/10Fail
GPT-5.4dual0/10Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States weighted average gross margin for BYD e-Platform 3.0 is 31.8%

  2. States weighted average gross margin for Ford C2 is 31.1%

  3. States weighted average gross margin for GM Ultium is 30.8%

  4. States weighted average gross margin for Hyundai E-GMP is 32.5%

  5. States weighted average gross margin for MLB Evo is 31.8%

  6. States weighted average gross margin for MQB is 32.0%

  7. States weighted average gross margin for Stellantis STLA Medium is 31.8%

  8. States weighted average gross margin for TNGA is 31.6%

  9. States weighted average gross margin for Volvo SPA2 is 32.3%

  10. States the percentage price increase on the GM Ultium platform required to match the weighted average gross margin of all other platforms is 1.6%