APEX-Agents · Management Consulting
World 128 - SF - Task 2
APEX-Agents task World 128 - SF - Task 2 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Based on our market survey knowledge regarding autonomous vehicles, compare their sentiment towards autonomous mobility. Compare two cohorts (18–34-year-olds and 45–64-year-olds) who live in North America, who have annual household incomes of more than $50K and who currently own a vehicle. State which of the two cohorts has the most positive overall sentiment and state their weighted averages. Weight the survey results as follows: - Very Negative: 1 - Negative: 2 - Neutral: 3 - Positive: 4 - Very Positive: 5 Round all calculations to the first decimal place. Print your findings as a reply to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 3/3 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the weighted average of overall sentiment toward autonomous mobility among the 45-64 year old cohort is 3.1
States that the cohort with the most positive overall sentiment toward autonomous mobility based on weighted average is 45-64 year olds
States that the weighted average of overall sentiment toward autonomous mobility among the 18-34 year old cohort is 2.8