Raycaster / evalsBack to AI Agents for SEC Disclosure Analysis

APEX-Agents · Investment Banking

world227_tg_02

0/1Fail

APEX-Agents task world227_tg_02 in AI Agents for SEC Disclosure Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for SEC Disclosure AnalysisInvestment Banking World 227Dual harnessGrader: rubric
task_9b9afdd77d4240a5bb3c13e83182b91b
Investment Banking World 227
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Using Option B in the MFC model, the refinancing in conjunction with a equity private placement (preferred stock), update to upsize the preferred tranche to $1.5bn and for interest to be payment-in-kind (PIK) rather than in cash. In addition, the preferred will now be redeemed at the end of 2030. When the preferred matures, MFC will aim to execute a refinancing for up to 4.5x of gross leverage (gross debt / LTM EBITDA). Use of proceeds from this re-financing will be applied to (a) pay off the preferred; and then (b) fund a shareholder special dividend Calculate the maximum size of the shareholder special dividend in $s to the nearest million. Print the answer here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal0/1Fail
GPT-5.4 minidual1/1Pass
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the maximum special dividend is $542m

    Fail

    Evidence: <TEXT_RESPONSE> says "$957 million". Assessment: The criterion requires stating that the maximum special dividend is $542m; the response gives a different amount, so it fails.