Raycaster / evalsBack to AI Agents for Infrastructure Finance

APEX-Agents · Investment Banking

world227_tg_08

1/1Pass

APEX-Agents task world227_tg_08 in AI Agents for Infrastructure Finance. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Infrastructure FinanceInvestment Banking World 227Dual harnessGrader: rubric
task_da562f15d91a4d4290026386d2aa1c47
Investment Banking World 227
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Please use assumptions below for a more aggressive financial forecast, which is termed the "SuperUpside" case: - The drivers of the SuperUpside case adds to the "Upside" case the difference between the "Base" and the "Upside" cases in the MFC model. - For example, if the "Base" case for FY23 revenue growth is 3% and the "Upside" case is 5%, then the "SuperUpside" case is 7% (5% Upside + 2% difference between Base and Upside). - As a further example, if the "Base" case COGS % sales is 20% and the "Upside" case COGS % sales is 19%, then the "SuperUpside" case is 18% (19% Upside - 1% difference) Please calculate the FY29 change in cash assuming that management has decided on a debt-only refinancing (Option A / Case 1 in the model "toggle"). Please reply back to me with the answer, rounded to the millions of dollars.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual1/1Pass
Gemini 3.1 Produal1/1Pass
GPT-5.4 minidual1/1Pass
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States FY29 change in cash is $642 million

    Pass

    Evidence: <TEXT_RESPONSE> states, “The FY29 change in cash ... is approximately CAD $642 million.” Assessment: Criterion “States FY29 change in cash is $642 million” is met; the response clearly gives $642 million, with currency/approximation not conflicting with rounded-to-millions requirement.