APEX-Agents · Management Consulting
World132_SF_Task05
APEX-Agents task World132_SF_Task05 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Comparing the revised projections for 2026-2030, what is the change in Japanese and Global 2026 results for Gross Profit and EBITDA in both dollar and percentage terms? If the 2026 Marketing costs in the Japanese market had instead improved to $2.33M, what will the 2026 Japanese market COGS need to be in order for to limit the global percentage change in EBITDA to -5%? Round intermediate and final calculations to 4 decimal places. Return all outputs as a message to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 1/9 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/9 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/9 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/9 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/9 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the 2026 dollar change in Japanese Gross Profit is -$0.5000M
States that the 2026 dollar change in Global Gross Profit is -$0.5000M
States that the 2026 percentage change in Japanese Gross Profit is -25.0000%
States that the 2026 percentage change in Global Gross Profit is -0.2784%
States that the 2026 dollar change in Japanese EBITDA is -$0.2000M
States that the 2026 dollar change in Global EBITDA is -$0.2000M
States that the 2026 percentage change in Japanese EBITDA is -2.2222%
States that the 2026 percentage change in Global EBITDA is -5.8824%
States that the revised 2026 Japanese market COGS to limit the Global EBITDA change to -5% is $5.8400M