APEX-Agents · Investment Banking

World228_SM_Task06

0/1Fail

APEX-Agents task World228_SM_Task06 in AI Agents for Tariff and Trade Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Tariff and Trade Law AnalysisInvestment Banking World 228Dual harnessGrader: rubric

Task IDtask_f58e573d229d46aeaa3edbaf35b7b95b

WorldInvestment Banking World 228

Expected outputmessage_in_console

Published runs4 models · dual config

Task prompt

What the agent was asked to do

Using the 2024 ATR annual report, analyze the results of a 15% tariff on Aptar Group’s FY2024 net income. Assume the 15% applies only to Cost of Sales, exclusive of depreciation and amortization. Round all values to the nearest thousand. Use a 20.35% tax rate. Output just the pro-forma net income as a reply here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	0/1	Fail	Share page Public trace
Gemini 3.1 Pro	dual	1/1	Pass	Share page Public trace
GPT-5.4 mini	dual	0/1	Fail	Share page Public trace
GPT-5.4 nano	dual	0/1	Fail	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States pro-forma Net Income is $108,051,000
Fail
Evidence: TEXT_RESPONSE states “$108,062,000.” Assessment: Criterion requires “States pro-forma Net Income is $108,051,000.” The response gives a different value, so it fails.