APEX-Agents · Management Consulting
World133_ln_04
APEX-Agents task World133_ln_04 in AI Agents for Divestiture and Spin-Off Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Give me the scores for Summit’s segments, using the Summit-Specific Survey. Your scoring system must follow these rules: - For the average satisfaction with status benefits from the file “14. Summit_Tier_Status_Experience_Raw_vtest.xlsx”, grant 1 point if it is greater than 2, grant 1 point if it has had no status loss in the past 2 years. Also grant 2 points if more than 23% of respondents in the segment have a current tier equal to "none". - Deduct 1 point if the loyalty score from the file “9. Summit_Loyalty_Outcome_Summary_Raw_vtest.xlsx” is below 2 but add 2.5 points if it's above 2. Present the results in a new one-slide deck. Give all answers rounded to one decimal point.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the Business segment score is 3.5
States the Family segment score is 5.5
States the Younger Leisure segment score is 5.5