APEX-Agents · Management Consulting

World112-1_TK_04

2/2Pass

APEX-Agents task World112-1_TK_04 in AI Agents for Hospitality Loyalty Strategy. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Hospitality Loyalty StrategyManagement Consulting World 112.1Dual harnessGrader: rubric

Task IDtask_854fefdbea5740a3a238c5930c2721e7

WorldManagement Consulting World 112.1

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

Can you please calculate the z score of US 2024 Average Monthly Revenue per Head, for all of Impact’s sites? Use a distribution of US 2024 Average Monthly Revenue per Head per site for all the sites in the attached file, which has the monthly US operational data for all of Impact’s and competitor’s sites. You can allocate the yearly revenue from the respective P&L equally across all the respective sites and months. Tell me here the z score of only the Impact site with the highest absolute z score, and the SiteID of this Impact site. Use the standard deviation formula for sample, not population. Round the final answer to two decimal places. Write back to me with what I've asked for.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	2/2	Pass	Share page Public trace
Gemini 3.1 Pro	dual	1/2	Fail	Share page Public trace
GPT-5.4	dual	2/2	Pass	Share page Public trace
GPT-5.4 mini	dual	2/2	Pass	Share page Public trace
GPT-5.4 nano	dual	2/2	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States the Impact site with the highest absolute z score is Lorexa
Pass
Evidence: <TEXT_RESPONSE> says "SiteID: `Lorexa`". Assessment: Criterion asks whether it states the Impact site with highest absolute z score is Lorexa; the response clearly identifies Lorexa, so pass.
States that the z score of Lorexa is -1.60
Pass
Evidence: <TEXT_RESPONSE> says "Z score: `-1.60`". Assessment: Criterion asks whether it states that the z score of Lorexa is -1.60; the response gives -1.60 for the listed SiteID Lorexa, so pass.