Raycaster/ Eval

APEX-Agents · Management Consulting

World 129_CY_Task 3

Best published0/4Fail

APEX-Agents task World 129_CY_Task 3 in AI Agents for Divestiture and Spin-Off Analysis. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Divestiture and Spin-Off AnalysisManagement Consulting World 129Dual harnessGrader: rubric
task_66b157482bf640cbb5c1725765e6ca9e
Management Consulting World 129
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Using the latest pricing version, the revenue data by segment, and the discount approval logs, determine the average discount percentage for each of the Business and Growth tiers separately (use the midpoint of the Company Size range as the user count). Then, calculate the %variance of each tier's discount relative to its average policy threshold. Provide the discount for each tier (rounded to the nearest 0.01%) as well as the variance from policy threshold (rounded to the nearest 0.01%) directly here as a reply.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal0/4Fail
GPT-5.4dual0/4Fail
GPT-5.4 minidual0/4Fail
GPT-5.4 nanodual0/4Fail
GPT-5.5dual0/4Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that the average discount for the Business tier is 28.45%

  2. States that the average discount given for the Growth tier is 3.82%

  3. States that the % variance between the discount and the policy threshold for the Business tier is 88.23%

  4. States that the % variance between the discount and the policy threshold for the Growth tier is -73.97%