APEX-Agents · Management Consulting
World 128 - SF - Task 2
APEX-Agents task World 128 - SF - Task 2 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Based on our market survey knowledge regarding autonomous vehicles, compare their sentiment towards autonomous mobility. Compare two cohorts (18–34-year-olds and 45–64-year-olds) who live in North America, who have annual household incomes of more than $50K and who currently own a vehicle. State which of the two cohorts has the most positive overall sentiment and state their weighted averages. Weight the survey results as follows: - Very Negative: 1 - Negative: 2 - Neutral: 3 - Positive: 4 - Very Positive: 5 Round all calculations to the first decimal place. Print your findings as a reply to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 3/3 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the weighted average of overall sentiment toward autonomous mobility among the 45-64 year old cohort is 3.1
PassEvidence: <TEXT_RESPONSE> table lists “45–64-year-olds | 91 | 3.1.” Assessment: The criterion asks whether it states the weighted average for the 45–64 cohort is 3.1; this is explicitly stated. Pass.
States that the cohort with the most positive overall sentiment toward autonomous mobility based on weighted average is 45-64 year olds
PassEvidence: <TEXT_RESPONSE> says “the 45–64 cohort has the more positive overall sentiment toward autonomous mobility” and “The 45–64 cohort is higher by 0.3 points.” Assessment: The criterion asks whether it identifies 45–64 year olds as the most positive cohort; the response clearly does. Pass.
States that the weighted average of overall sentiment toward autonomous mobility among the 18-34 year old cohort is 2.8
PassEvidence: <TEXT_RESPONSE> table lists “18–34-year-olds | 89 | 2.8.” Assessment: The criterion asks whether it states the weighted average for the 18–34 cohort is 2.8; this is explicitly stated. Pass.