Raycaster/ Eval

APEX-Agents · Investment Banking

World228_JP_01

Best published1/1Pass

APEX-Agents task World228_JP_01 in AI Agents for Merger Models. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Merger ModelsInvestment Banking World 228Dual harnessGrader: rubric
task_326a170f1d6440988779b2ef1dac919f
Investment Banking World 228
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Using the 2024 ATR annual report, reply to me with the absolute performance difference between ATR shares and the Peer Group in 2024 as a percentage (round this to two decimal places).

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal1/1Pass
GPT-5.4 minidual0/1Fail
GPT-5.4 nanodual0/1Fail
GPT-5.5dual0/1Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States the difference in share performance is 28.61%