Raycaster/ Eval

APEX-Agents · Management Consulting

Task_World130_CamilleMoingeon_3

Best published6/6Pass

APEX-Agents task Task_World130_CamilleMoingeon_3 in AI Agents for Comparable Company Analysis. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Comparable Company AnalysisManagement Consulting World 130Dual harnessGrader: rubric
task_9363f85adf864ccaa8dbff72d38225cb
Management Consulting World 130
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Using HarFeast's baseline diagnostic dataset, assess the impact of predictive maintenance on HarFeast's scrap rate. We will pilot predictive maintenance only on equipment a) whose scheduled hours per year are at or above that equipment type's median scheduled hours and b) whose labor hours are at or above its plant's median labor hours. For all equipment qualifying for the pilot, apply the improvement assumptions from the Gogo Food case study. 1. Calculate the new overall scrap rates per product family, rounded to one decimal point place. 2. Calculate the total scrap units each product family avoids per year after these improvements, rounded to the nearest whole number. Please return all results to me in your reply.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal6/6Pass
GPT-5.4dual4/6Fail
GPT-5.4 minidual4/6Fail
GPT-5.5dual2/6Fail
GPT-5.4 nanodual1/6Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that the new overall scrap rate for the Canned Vegetables product family is 6.7%

  2. States that the new overall scrap rate for the Condiments product family is 6.6%

  3. States that the new overall scrap rate for the Sauces product family is 6.6%

  4. States that the total number of scrap units the Canned Vegetables product family avoids every year as a result of these changes is 290,497

  5. States that the total number of scrap units the Condiments product family avoids every year as a result of these changes is 329,588

  6. States that the total number of scrap units the Sauces product family avoids every year as a result of these changes is 283,526