APEX-Agents · Investment Banking
World228_JP_01
Best published1/1Pass
APEX-Agents task World228_JP_01 in AI Agents for Merger Models. Compare dual-harness agent runs across models, scores, and public traces.
AI Agents for Merger ModelsInvestment Banking World 228Dual harnessGrader: rubric
Task prompt
What the agent was asked to do
Using the 2024 ATR annual report, reply to me with the absolute performance difference between ATR shares and the Peer Group in 2024 as a percentage (round this to two decimal places).
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/1 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the difference in share performance is 28.61%