APEX-Agents · Management Consulting
Task 3uy1546e
APEX-Agents task Task 3uy1546e in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Determine which years have the highest and lowest average stay lengths for Bronze Tier members. For each of those years, report the average stay length for Bronze Tier members who stayed at a Summit Express property, segmented by whether they used a co-branded credit card or not. Use the latest merged member profile data spreadsheets file and the stay & booking data spreadsheets files for the analysis. Use check-in date to determine the date of stay. Return your answers to me here, with numerical values rounded to the nearest 0.1.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/6 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 3/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the year with the highest average stay length for Bronze Tier members is 2022
States that the year with the lowest average stay length for Bronze Tier members is 2025
States that in 2022 the average stay length for Bronze Tier members with a cobranded credit card who stayed at a Summit Express is 4.6 days
States that in 2022 the average stay length for Bronze Tier members without a cobranded credit card who stayed at a Summit Express is 3.8 days
States that in 2025 the average stay length for Bronze Tier members with a cobranded credit card who stayed at a Summit Express is 2.8 days
States that in 2025 the average stay length for Bronze Tier members without a cobranded credit card who stayed at a Summit Express is 4.1 days