APEX-Agents · Management Consulting
World112-1_Task02_NA
APEX-Agents task World112-1_Task02_NA in AI Agents for Hospitality Loyalty Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Calculate the difference in dollars between Impact's actual 2024 US COGS and the hypothetical US COGS if they reached the straight average of COGS as a percentage of revenue given in Exhibit 2 of the BCG report. - Use absolute values for all calculations. - P&L values are in thousands of dollars ($K). - Round all percentages to the nearest whole percent before calculations. - Round all dollar values in the calculations to the nearest $0.01. - Round dollar to the nearest integer in your output. State whether the Site Ops savings target in the check-in deck is a "realistic target." That means it must be less than or equal to 1.15 times the value determined above. Please give me your answers here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 1/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the difference between Impact's 2024 COGS and their 2024 COGS if they were to reach the industry average of COGS as a share of revenue is $252,251,040
States that the site ops savings target is a realistic target