APEX-Agents · Management Consulting
world133_ln_03
APEX-Agents task world133_ln_03 in AI Agents for Hospitality Loyalty Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Determine CAGR for total points sold over the entire covered time period from the Profit and Loss Master Profitability Workbook. Apply that growth rate to average points per member from the Member Points Summary (Balance & Expiry) Sheet to project points per member (PPM) per year, 2 years out. Assume the average in this data set is the year end 2025 average. Return the state Average PPM and CAGR of points sold for the base year and each of the two years out in a New spreadsheet. Round to two decimals.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 2/4 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 2/4 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/4 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/4 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/4 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States base year average PPM is 10,346.98
States CAGR of total points sold over the entire time period is 3.01%
States average PPM for 2026 is 10,658.42
States average PPM for 2027 is 10,979.24