Raycaster/ Eval

APEX-Agents · Management Consulting

World 134 Nancy Task 04

Best published7/7Pass

APEX-Agents task World 134 Nancy Task 04 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 134Dual harnessGrader: rubric
task_b7b8e91422ef483f8464df1538f575e8
Management Consulting World 134
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

We anticipate the following developments in 2026: 1) Market growth is forecast to stall to 0% over 2025 market size (per our latest 5 year forecast, which also includes all required CompliSure financials) 2) The market participant with the smallest operating margin is expected to exit the market 3) Remaining players are expected to split the exited market share proportionally (based on their respective 2025B market share) State each remaining competitor's forecasted revenue and operating income in 2026, assuming these developments are reflected. Then, identify all players with both higher expected operating income ($) and a higher operating margin (%) than CompliSure. Assume operating income % in 2026 is expected to remain at the same rate as 2025B. Round answers to the nearest thousand. Use the 2016-2025 financials to get the financial data for CompliSure and competitors. Reply straight back here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.4dual7/7Pass
GPT-5.4 minidual7/7Pass
Gemini 3.1 Produal1/7Fail
GPT-5.4 nanodual1/7Fail
GPT-5.5dual1/7Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States Syncore 2026 revenue is $197,703,000

  2. States Velocity 2026 revenue is $103,888,000

  3. States UpSkill 2026 revenue is $72,239,000

  4. States Syncore 2026 operating income is $15,619,000

  5. States Velocity operating income is $3,428,000

  6. States Upskill operating income is $795,000

  7. States that no player is expected to have both higher operating income and operating margin than CompliSure