APEX-Agents · Management Consulting

Task he84c0f2

6/6Pass

APEX-Agents task Task he84c0f2 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 129Dual harnessGrader: rubric

Task IDtask_a138d5329a0a494996a505f2adda0a65

WorldManagement Consulting World 129

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

Use the churn and WinLoss data, and assume the following: - Competitor Loss Ratio = (Total Contract Value of Lost deals/Total Contract Value of all deals) - If competitor-lost deal value exceeds the retained renewal ARR for that tier: Increase the churned ARR for that tier by 15% - If retained renewal ARR exceeds competitor-lost deal value: Reduce the competitor-lost contract value by 50% - Severity Score = Adjusted Competitor Pressure + (Adjusted Churn Rate x (Adjusted Competitor Lost Value/ Original ARR)) - Competitive Exposure Multiplier = Highest Severity Score ÷ Adjusted Competitor Pressure of that tier - Scenario Sensitivity Factor = Highest Severity Score * (Adjusted Competitor Pressure + Adjusted Churn Rate) Answer the following questions: 1. Which pricing tier has the highest severity score? 2. What is the highest severity score? 3. For the tier identified with the highest severity score, what is the single most frequent competitor appearing in lost deals? (If multiple competitors, return the alphabetically first) 4. For the tier identified with the highest severity score, calculate the Severity Score to Adjusted Churn Rate ratio 5. For the tier identified with the highest severity score, calculate the Competitive Exposure Multiplier? 6. For the tier identified with the highest severity score, calculate the Scenario Sensitivity Factor? Return the responses to the questions right here as a message. Round all final outputs to 2 decimal places.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	6/6	Pass	Share page Public trace
Gemini 3.1 Pro	dual	2/6	Fail	Share page Public trace
GPT-5.4	dual	6/6	Pass	Share page Public trace
GPT-5.4 mini	dual	6/6	Pass	Share page Public trace
GPT-5.4 nano	dual	6/6	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States that the pricing tier with the highest severity score is "Team"
Pass
Evidence: TEXT_RESPONSE says “Highest severity pricing tier: **Team**.” Assessment: Criterion requires stating highest severity tier is “Team”; pass.
States that the highest severity score is 0.28
Pass
Evidence: TEXT_RESPONSE says “Highest severity score: **0.28**.” Assessment: Criterion requires stating highest severity score is 0.28; pass.
States that the single most frequent competitor appearing in lost deals in the highest severity score pricing tier is "Make"
Pass
Evidence: TEXT_RESPONSE says “Most frequent lost-deal competitor for that tier: **Make**.” Assessment: Criterion requires stating the single most frequent competitor is “Make”; pass.
States that the Severity Score to Adjusted Churn Rate ratio for the tier identified with the highest severity score is 1.49
Pass
Evidence: TEXT_RESPONSE says “Severity Score to Adjusted Churn Rate ratio: **1.49**.” Assessment: Criterion requires stating the ratio is 1.49; pass.
States that the Competitive Exposure Multiplier for the tier identified with the highest severity score is 1.28
Pass
Evidence: TEXT_RESPONSE says “Competitive Exposure Multiplier: **1.28**.” Assessment: Criterion requires stating the Competitive Exposure Multiplier is 1.28; pass.
States that the Scenario Sensitivity Factor for the tier identified with the highest severity score is 0.12
Pass
Evidence: TEXT_RESPONSE says “Scenario Sensitivity Factor: **0.12**.” Assessment: Criterion requires stating the Scenario Sensitivity Factor is 0.12; pass.