Raycaster/ Eval

APEX-Agents · Management Consulting

World112-1_Task05_SC

Best published3/3Pass

APEX-Agents task World112-1_Task05_SC in AI Agents for Comparable Company Analysis. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Comparable Company AnalysisManagement Consulting World 112.1Dual harnessGrader: rubric
task_7c7edc1b3dea41ec89f00eb4581df3fa
Management Consulting World 112.1
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Review industry reports to determine the range of industry-wide reductions in force (RIFs). Using Impact’s revised SG&A breakdown, calculate the cost savings Impact would achieve by reducing its sales force by comparable amounts, testing both the low and high ends of the range. Using 2024 figures, assess whether these reductions are sufficient to achieve a 20% total reduction in Sales & Marketing expense. If not, calculate the percentage reduction in the sales force required to reach the 20% Sales & Marketing cut. Round final answers to the nearest 0.01% or $0.01. Print out your findings to me here now.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.4dual3/3Pass
GPT-5.4 minidual3/3Pass
GPT-5.4 nanodual3/3Pass
GPT-5.5dual3/3Pass
Gemini 3.1 Produal1/3Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that if Impact were to cut sales force by 30%, it would save $216,339.30

  2. States that If Impact were to cut sales force by 50%, it would save $360,565.50

  3. States that the % reduction in sales force needed to reach 20% in Sales & Marketing cuts is 57.60%