APEX-Agents · Management Consulting

World 134_RG_03

0/1Fail

APEX-Agents task World 134_RG_03 in AI Agents for Tax Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Tax Due DiligenceManagement Consulting World 134Dual harnessGrader: rubric

Task IDtask_a1449f78d0c3427e9b34e65a08621976

WorldManagement Consulting World 134

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

Can you please help me re-evaluate and state the adjusted 2030 net income for Complisure? The 2030 adjusted net income will be based on the three key assumptions: 1) New Sales and marketing spend, and New hosting and infrastructure in accordance with the attached expense growth rate file only, beyond 2025, 2) All other spending would remain similar to the 2026 baseline figures, 3) Tax rates would be identical to those in effect in the 2026 baseline figures. Use the latest version of the 5-year forecast. Round the final answer to 2 decimal places in M. Please provide your answer directly here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	0/1	Fail	Share page Public trace
Gemini 3.1 Pro	dual	0/1	Fail	Share page Public trace
GPT-5.4	dual	0/1	Fail	Share page Public trace
GPT-5.4 mini	dual	0/1	Fail	Share page Public trace
GPT-5.4 nano	dual	0/1	Fail	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States the adjusted 2030 net income for Complisure is $9.90m
Fail
Evidence: <TEXT_RESPONSE> states “Adjusted 2030 net income for Complisure: $95.18M.” Assessment: The criterion requires stating the adjusted 2030 net income is $9.90m; the response gives $95.18M instead, so it fails.