Raycaster/ Eval

APEX-Agents · Management Consulting

World 134_RG_04

Best published6/6Pass

APEX-Agents task World 134_RG_04 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 134Dual harnessGrader: rubric
task_d87f70c7f8d74665ac3ddcbef5a8d67a
Management Consulting World 134
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

One of CompliSure’s primary competitors, TrainIQ, is expected to lose a portion of its market share. Use the estimates provided by each research firm (A, B, C), provided in the attached report, as separate scenarios. For each scenario, assume that the overall market size in 2025 does not change, and that any market share lost by TrainIQ is fully captured by CompliSure, with no impact on other competitors. Starting from CompliSure’s 2025 base-case outlook, state the new CompliSure’s market share (%) and revenue in 2025 for each research-firm scenario. Use our latest version of the 5-year forecast and the expanded version of the financial dataset to do the analysis. Round all the final answers to two decimal places and round $ figures to $0.01M. Give your answer back to me right here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal6/6Pass
GPT-5.4 minidual6/6Pass
GPT-5.4 nanodual6/6Pass
GPT-5.4dual0/6Fail
GPT-5.5dual0/6Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that New CompliSure’s 2025 Market share for the Firm 1 scenario is 11.05%

  2. States that New CompliSure’s 2025 Market share for the Firm 2 scenario is 11.99%

  3. States that New CompliSure’s 2025 Market share for the Firm 3 scenario is 13.10%

  4. States that the New CompliSure’s 2025 Revenue for Firm 1 scenario is $46.76M

  5. States that the New CompliSure’s 2025 Revenue for Firm 2 scenario is $50.70M

  6. States that the New CompliSure’s 2025 Revenue for Firm 3 scenario is $55.42M