APEX-Agents · Management Consulting
World 128_RG_06
APEX-Agents task World 128_RG_06 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Can you use the Amensa scenario model and provide the revised 2024 operating income for each project after adjusting their R&D spend for the year? Assume all the other variables remain the same. Use the upper value of the solid bar in the 2024 R&D candlestick chart from the attached file as the adjusted R&D spend. Round all final answers to 1 decimal place, i.e., $0.1B. Please provide your answers in a New spreadsheet.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 4/4 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 4/4 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 4/4 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the revised operating income for AmensaDrive is -$3.3 billion
PassEvidence: TEXT_RESPONSE table lists “AmensaDrive | ($3.3B)”. Assessment: Criterion requires states revised operating income for AmensaDrive is -$3.3 billion; pass because the response clearly states ($3.3B).
States that the revised operating income for SkyLink Atmos is -$2.5 billion
PassEvidence: TEXT_RESPONSE table lists “SkyLink Atmos | ($2.5B)”. Assessment: Criterion requires states revised operating income for SkyLink Atmos is -$2.5 billion; pass because the response clearly states ($2.5B).
States that the revised operating income for AmensaMech is -$3.6 billion
PassEvidence: TEXT_RESPONSE table lists “AmensaMech | ($3.6B)”. Assessment: Criterion requires states revised operating income for AmensaMech is -$3.6 billion; pass because the response clearly states ($3.6B).
States that the revised operating income for SolisOne is -$1.6 billion
PassEvidence: TEXT_RESPONSE table lists “SolisOne | ($1.6B)”. Assessment: Criterion requires states revised operating income for SolisOne is -$1.6 billion; pass because the response clearly states ($1.6B).