APEX-Agents · Management Consulting

CW134 Aditi 01

8/8Pass

APEX-Agents task CW134 Aditi 01 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 134Dual harnessGrader: rubric

Task IDtask_11c9d4cb0cf3401b8de7cff9969fc223

WorldManagement Consulting World 134

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

For each of the four competitor firms use use our financial dataset for 2016 - 2025 to calculate the average customer acquisition cost (US$) for 2016-24 and identify the competitor with the highest churn rate (%) in 2024 and calculate the percentage difference relative to their average between that competitor with the highest churn rate (%) and each of the remaining competitors. Round all percent final answers to the nearest 0.01%. Round $ amounts to the nearest whole $. Print your answer to me here as a message.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	8/8	Pass	Share page Public trace
Gemini 3.1 Pro	dual	8/8	Pass	Share page Public trace
GPT-5.4	dual	8/8	Pass	Share page Public trace
GPT-5.4 mini	dual	8/8	Pass	Share page Public trace
GPT-5.4 nano	dual	5/8	Fail	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States that 2016-24 average customer acquisition cost for Velocity is US$7,742
Pass
Evidence: TEXT_RESPONSE table lists “Velocity | $7,742” under “Average customer acquisition cost, 2016–2024.” Assessment: Criterion asks whether it states Velocity average CAC is US$7,742; pass.
States that 2016-24 average customer acquisition cost for Syncore is US$7,398
Pass
Evidence: TEXT_RESPONSE table lists “Syncore | $7,398” under “Average customer acquisition cost, 2016–2024.” Assessment: Criterion asks whether it states Syncore average CAC is US$7,398; pass.
States that 2016-24 average customer acquisition cost for UpSkill is US$6,949
Pass
Evidence: TEXT_RESPONSE table lists “UpSkill | $6,949” under “Average customer acquisition cost, 2016–2024.” Assessment: Criterion asks whether it states UpSkill average CAC is US$6,949; pass.
States that 2016-24 average customer acquisition cost for TrainIQ is US$6,455
Pass
Evidence: TEXT_RESPONSE table lists “TrainIQ | $6,455” under “Average customer acquisition cost, 2016–2024.” Assessment: Criterion asks whether it states TrainIQ average CAC is US$6,455; pass.
States that competitor with the highest churn rate (%) in 2024 is UpSkill
Pass
Evidence: TEXT_RESPONSE says “Highest 2024 churn rate: UpSkill at 8.90%.” Assessment: Criterion asks whether it states the competitor with highest 2024 churn is UpSkill; pass.
States that percentage difference relative to their average between Upskill and TrainIQ is 17.07%
Pass
Evidence: TEXT_RESPONSE comparison table lists “UpSkill vs. TrainIQ | 8.90% vs. 7.50% | 17.07%.” Assessment: Criterion asks whether it states percentage difference between UpSkill and TrainIQ is 17.07%; pass.
States that percentage difference relative to their average between Upskill and Velocity is 28.21%
Pass
Evidence: TEXT_RESPONSE comparison table lists “UpSkill vs. Velocity | 8.90% vs. 6.70% | 28.21%.” Assessment: Criterion asks whether it states percentage difference between UpSkill and Velocity is 28.21%; pass.
States that percentage difference relative to their average between Upskill and Syncore is 45.52%
Pass
Evidence: TEXT_RESPONSE comparison table lists “UpSkill vs. Syncore | 8.90% vs. 5.60% | 45.52%.” Assessment: Criterion asks whether it states percentage difference between UpSkill and Syncore is 45.52%; pass.