APEX-Agents · Investment Banking

World228_JP_05

0/1Fail

APEX-Agents task World228_JP_05 in AI Agents for FDA and Pharma Promotional Compliance. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for FDA and Pharma Promotional ComplianceInvestment Banking World 228Dual harnessGrader: rubric

Task IDtask_a7571304d554476498169424570451e3

WorldInvestment Banking World 228

Expected outputmessage_in_console

Published runs4 models · dual config

Task prompt

What the agent was asked to do

ATR is expecting to write down the goodwill related to Pharma to zero following the merger with GXI. Referring to the 2024 ATR 10K calculate the new total ending Goodwill under this write down scenario and output the number. Round it to the nearest thousand dollars. Tell me the information that I want in here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	0/1	Fail	Share page Public trace
Gemini 3.1 Pro	dual	1/1	Pass	Share page Public trace
GPT-5.4 mini	dual	1/1	Pass	Share page Public trace
GPT-5.4 nano	dual	1/1	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States the total ending Goodwill after the write down is $769,575,000
Fail
Evidence: TEXT_RESPONSE states “$448,022,000” and calculation “$936,256,000 total ending goodwill - $488,234,000 Aptar Pharma goodwill = $448,022,000.” Assessment: The criterion requires stating the total ending Goodwill after the write down is $769,575,000; the response gives a different amount, so it fails.