APEX-Agents · Management Consulting
world130_HO_08
APEX-Agents task world130_HO_08 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
The client sent us employee wage data (attached), so we need to update our assumptions in the financial analysis section of the survey analysis report to display the updated annual productivity loss figures (in 000s). Find the average hourly salary of employee roles and use that to update the annual productivity loss estimate (rounded to 1 decimal place). Assume average hourly wages in the data are fully-loaded costs. Assume the following activities are non-productive: manual data entry, searching for data, and fixing errors. Report final answers here, written out in a short message.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/2 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the updated annual productivity loss is $50,494,000
States the average fully-loaded hourly wage used to calculate the annual productivity loss is $28.90