Raycaster/ Eval

APEX-Agents · Management Consulting

Shiva Task 01 World 129

Best published3/3Pass

APEX-Agents task Shiva Task 01 World 129 in AI Agents for Divestiture and Spin-Off Analysis. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Divestiture and Spin-Off AnalysisManagement Consulting World 129Dual harnessGrader: rubric
task_f69f5d19990b4292809009a331e1bbe9
Management Consulting World 129
message_in_console
6 models · dual config

Task prompt

What the agent was asked to do

Using the estimated market share chart and Brightpath customer segmentation, please calculate the potential revenue for the SMB Accounting segment if it achieved the target share. Include an analysis stating the percentage point difference (rounded down) between Target and Actual Enterprise share for Consulting Firms and the revenue gap (to the nearest dollar) for Mid-Market IT Services. Return your findings in a short message here

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal3/3Pass
GPT-5.4 nanodual3/3Pass
GPT-5.4 minidual2/3Fail
GPT-5.5dual2/3Fail
Gemini 3 Flashdual1/3Fail
GPT-5.4dual0/3Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States the potential revenue for the SMB segment in the Accounting industry if it achieved the Target share is $670,508

  2. States the percentage points difference between the Target Enterprise share for Consulting Firms and the Actual Enterprise share is 4.

  3. States the revenue gap if the company achieved targeted market share from share vs. actual data for Mid-Market in IT Services is $14,331