APEX-Agents · Management Consulting
World 133 - NK Task #1
APEX-Agents task World 133 - NK Task #1 in AI Agents for Hospitality Loyalty Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
What are the projected 2026 aggregate free night bookings for Marriott, Hilton, and Hyatt in New York, London, and Tokyo combined? Assume all of Summit's 2026P free night certificate redemptions from the PNL (in thousands) are projected to be exclusively in either New York, London, or Tokyo. What would Summit's expected free night relative market share be in each market? Provide values to one decimal place. Express RMS as a percentage. Print your reply here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 | dual | 1/4 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/4 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/4 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 1/4 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/4 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the combined 2026 free nights in NYC, London, and Tokyo for Marriott, Hilton, and Hyatt is 203,000.0
States Summit's 2026 RMS in New York is 37.5%
States Summit's 2026 RMS in London is 33.3%
States Summit's 2026 RMS in Tokyo is 46.9%