Raycaster / evalsBack to AI Agents for Real Estate Lease Review

APEX-Agents · Investment Banking

World246_AS_01

5/5Pass

APEX-Agents task World246_AS_01 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Real Estate Lease ReviewInvestment Banking World 246Dual harnessGrader: rubric
task_5a7117ac62fd4da9bec41fe8d805ee03
Investment Banking World 246
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Please audit the financials of the smallest company in our Refined Comps table by market cap using only the IS, CFS, and BS from sec filings and data tools available to you. Report Adjusted EBITDA and EV in thousands of dollars. Report EV/EBITDA to two decimal points. Calculate the following, and report it back to me with a message here: - Adjusted TTM EBITDA including SBC addback - Adjusted TTM EBITDA excluding SBC addback - EV as of 12/17/25 (use basic weighted-average shares from the latest 10-Q and include all lease liabilities) - EV / adjusted TTM EBITDA (incl SBC) - EV / adjusted TTM EBITDA (excl SBC) Note: Adjusted EBITDA defined as operating income and cash-flow non-cash addbacks, excluding non-cash operating lease cost.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual5/5Pass
Gemini 3.1 Produal1/5Fail
GPT-5.4 minidual1/5Fail
GPT-5.4 nanodual1/5Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States adjusted TTM EBITDA (incl SBC) is $386,471,000

    Pass

    Evidence: <TEXT_RESPONSE> table states “Adjusted TTM EBITDA including SBC addback | $386,471k.” Assessment: Criterion requires stating adjusted TTM EBITDA (incl SBC) is $386,471,000; $386,471k equals $386,471,000, so pass.

  2. States adjusted TTM EBITDA (excl SBC) is $375,424,000

    Pass

    Evidence: <TEXT_RESPONSE> table states “Adjusted TTM EBITDA excluding SBC addback | $375,424k.” Assessment: Criterion requires stating adjusted TTM EBITDA (excl SBC) is $375,424,000; $375,424k equals $375,424,000, so pass.

  3. States EV is $3,977,156,000

    Pass

    Evidence: <TEXT_RESPONSE> table states “EV as of 12/17/25 | $3,977,156k.” Assessment: Criterion requires stating EV is $3,977,156,000; $3,977,156k equals $3,977,156,000, so pass.

  4. States EV / adjusted TTM EBITDA (incl SBC) is 10.29x

    Pass

    Evidence: <TEXT_RESPONSE> table states “EV / adjusted TTM EBITDA including SBC | 10.29x.” Assessment: Criterion requires stating EV / adjusted TTM EBITDA (incl SBC) is 10.29x; the response states exactly that, so pass.

  5. States EV / adjusted TTM EBITDA (excl SBC) is 10.59x

    Pass

    Evidence: <TEXT_RESPONSE> table states “EV / adjusted TTM EBITDA excluding SBC | 10.59x.” Assessment: Criterion requires stating EV / adjusted TTM EBITDA (excl SBC) is 10.59x; the response states exactly that, so pass.