Raycaster/ Eval

APEX-Agents · Management Consulting

world130_HO_04

Best published9/9Pass

APEX-Agents task world130_HO_04 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Employment Law AnalysisManagement Consulting World 130Dual harnessGrader: rubric
task_619f045f82f340a3871847bf1e7e2b40
Management Consulting World 130
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

I want to quantify the average annual productivity loss at a cost level for each employee in each primary role based on the sum of average hours spent doing manual entry, searching data, and fixing errors. Then, I want to calculate the total productivity loss cost HarFeast faces every year, company-wide. Note that the survey responses represent one week of work. Report your final answer as a message here, rounded to the nearest dollar.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.4 minidual9/9Pass
Gemini 3.1 Produal0/9Fail
GPT-5.4dual0/9Fail
GPT-5.4 nanodual0/9Fail
GPT-5.5dual0/9Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States the average annual productivity loss cost of an Administrative/Support Staff employee is $6,232

  2. States the average annual productivity loss cost of a Demand Planning/Forecasting employee is $9,504

  3. States the average annual productivity loss cost of a Maintenance Technician employee is $8,088

  4. States the average annual productivity loss cost of a Plant Management employee is $12,563

  5. States the average annual productivity loss cost of a Production Supervisor/Team Lead employee is $8,549

  6. States the average annual productivity loss cost of a Production/Manufacturing Operator employee is $5,767

  7. States the average annual productivity loss cost of a Quality Control/Quality Assurance employee is $7,359

  8. States the average annual productivity loss cost of a Supply Chain/Logistics Coordinator is $8,189

  9. States the total annual productivity loss cost is $12,622,039