Raycaster / evalsBack to AI Agents for Tax Due Diligence

APEX-Agents · Investment Banking

World246_RL_04

0/1Fail

APEX-Agents task World246_RL_04 in AI Agents for Tax Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Tax Due DiligenceInvestment Banking World 246Dual harnessGrader: rubric
task_c99cdf2356174ea8a0fc7a4f9b4e95f4
Investment Banking World 246
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Update the DCF model with the following changes - tax rate for the entire projection period (2025E-2029E) and the WACC build is now the implied tax rate from the second quarter of 2023, calculated as income tax expense over revenue, plus 10% - update beta to 1 - assume revenue growth rate in the projection period matches that of 2024A plus 75 basis points. - update terminal growth rate to be equal to the updated monthly revenue growth rate plus 50 basis points - assume final gross debt is increased by 50% and cash balance is now 10% of the absolute increased gross debt number What is equity value in millions rounded to the nearest whole number? Print your answer back to me as a short message.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal0/1Fail
GPT-5.4 minidual1/1Pass
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States the equity value is $16,549 million

    Fail

    Evidence: <TEXT_RESPONSE> says, “Updated equity value: $16,011 million.” Assessment: The criterion requires that the response “States the equity value is $16,549 million.” The stated value differs from the required $16,549 million, so this fails.