APEX-Agents · Management Consulting
W134 Nancy Task 09
APEX-Agents task W134 Nancy Task 09 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
If competitors continue growing by their 2021-2024 revenue CAGR, while their operating margin % stays flat from 2025, which players will have better operating income than CompliSure by 2030? How much will they be better? Use the financial dataset for 2016 to '25, along with our 5 year forecast. Round to the nearest thousand. Reply to me with your answer here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/2 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 1/2 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 0/2 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/2 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 0/2 | Fail | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that Syncore will have better operating income than Complisure by 2030
PassEvidence: The response states, “Syncore | $26,062,000 | Yes | $18,725,000” and “the only player projected to have better 2030 operating income than CompliSure is Syncore.” Assessment: Criterion asks whether it states Syncore will have better operating income than CompliSure by 2030; pass, this is explicitly stated.
States that Syncore's expected 2030 operating income is $17,720,000 higher than Complisure's
FailEvidence: The response states Syncore’s “Amount Better” is “$18,725,000” and says “by approximately $18.725 million.” Assessment: Criterion requires stating Syncore is $17,720,000 higher than CompliSure; fail, the response gives a different amount.