Raycaster / evalsBack to AI Agents for Legal Contract Review

APEX-Agents · Investment Banking

World226_SK_Task02

2/2Pass

APEX-Agents task World226_SK_Task02 in AI Agents for Legal Contract Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Legal Contract ReviewInvestment Banking World 226Dual harnessGrader: rubric
task_e15e357afdd942fbb5129561ed3dca2d
Investment Banking World 226
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Calculate the sponsor equity value and IRR for FY2030, then report the sponsor equity value in US dollars, rounded to the nearest million. Report the IRR to one decimal place. Reference the LBO model where needed. Note: the LBO model has an error. Mandatory Debt Repayments in the Levered Free Cash Flow build should be set to $0 to correct the error. Use the following specifications: - Decrease “Secured term loan - USD tranche” yield from 7.5% to 5.0%. - Increase annual mandatory amortization of the “Secured term loan – USD tranche” to 7.5% of the opening principal balance of $3,432mm. - Hold revenue growth constant at 13.0% per year from FY2026 to FY2030; model drivers should reflect the updated revenue growth (for avoidance of doubt, OpEx remains unchanged vs the base case in $ terms). - Only 10.0% of the cash available for total debt service in each year is allocated to the optional repayment of the secured term loan. Give me the answers here in the console.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual2/2Pass
Gemini 3.1 Produal0/2Fail
GPT-5.4 minidual0/2Fail
GPT-5.4 nanodual0/2Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States Sponsor Equity Value in FY2030 is $25,655

    Pass

    Evidence: <TEXT_RESPONSE> states “Sponsor equity value, FY2030: $25,655 million.” Assessment: Criterion asks whether it states Sponsor Equity Value in FY2030 is $25,655; pass because the response gives exactly $25,655 million.

  2. States IRR in FY2030 is 23.9%

    Pass

    Evidence: <TEXT_RESPONSE> states “IRR: 23.9%.” Assessment: Criterion asks whether it states IRR in FY2030 is 23.9%; pass because the response gives exactly 23.9%.