APEX-Agents · Management Consulting
W134 Nancy Task 10
APEX-Agents task W134 Nancy Task 10 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Can you use the customer usage and customer contracts files to state the impact on ARR and the new ARR if Complisure switches to the attached usage-based pricing model? Treat the payment discounts from the customer contracts summary as additional discounts that would still apply. Round the final numbers to the nearest thousand. Print the answer right here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 2/2 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the incremental impact to ARR is an increase of $1,064,000
States the new ARR is $22,206,000