Raycaster / evalsBack to AI Agents for M&A Legal Due Diligence

APEX-Agents · Investment Banking

World221_oa_8

0/1Fail

APEX-Agents task World221_oa_8 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceInvestment Banking World 221Dual harnessGrader: rubric
task_ffdcc07950ab47418648fbcf5a8fea25
Investment Banking World 221
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Recalculate "Additional paid-in capital" that factors in share buy-back of 10 million shares by BBDC. Print the answer as a reply to me here. Assume that the transaction was financed using cash on the balance sheet. Additional optional Debt is triggered only if cash drops below $10 million keeping balance sheet cash at a minimum of $10 million. Use the 9M 2025 account. Round monetary values to the nearest USD thousand.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal1/1Pass
GPT-5.4 minidual0/1Fail
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the Paid-in capital of BBDC using the 9M 2025 account is 1,757,248,000

    Fail

    Evidence: <TEXT_RESPONSE> states “Recalculated Additional paid-in capital: $1,757,048 thousand” and “Revised APIC... = $1,757,048 thousand.” Assessment: The criterion requires stating BBDC paid-in capital using the 9M 2025 account is 1,757,248,000. The response states 1,757,048,000, which differs by 200,000, so this fails.