APEX-Agents · Management Consulting
CW134 Aditi 01
APEX-Agents task CW134 Aditi 01 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
For each of the four competitor firms use use our financial dataset for 2016 - 2025 to calculate the average customer acquisition cost (US$) for 2016-24 and identify the competitor with the highest churn rate (%) in 2024 and calculate the percentage difference relative to their average between that competitor with the highest churn rate (%) and each of the remaining competitors. Round all percent final answers to the nearest 0.01%. Round $ amounts to the nearest whole $. Print your answer to me here as a message.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 8/8 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 8/8 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 8/8 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 8/8 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 5/8 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that 2016-24 average customer acquisition cost for Velocity is US$7,742
States that 2016-24 average customer acquisition cost for Syncore is US$7,398
States that 2016-24 average customer acquisition cost for UpSkill is US$6,949
States that 2016-24 average customer acquisition cost for TrainIQ is US$6,455
States that competitor with the highest churn rate (%) in 2024 is UpSkill
States that percentage difference relative to their average between Upskill and TrainIQ is 17.07%
States that percentage difference relative to their average between Upskill and Velocity is 28.21%
States that percentage difference relative to their average between Upskill and Syncore is 45.52%