APEX-Agents · Management Consulting
World 128 - NK - Task 1
APEX-Agents task World 128 - NK - Task 1 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Let's evaluate the new market intelligence we've received to figure out the RMS for competitors in each city. Tell me how many of these cities AmensaDrive operates in in 2026. Format answers to two decimal points. Provide your response right here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 6/9 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 1/9 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/9 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/9 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 1/9 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States Waymo RMS in Los Angeles is 1.00
States Cruise RMS in Los Angeles is 0.75
States Tesla RMS in Los Angeles is 0.50
States Waymo RMS in San Francisco is 1.00
States Cruise RMS in San Francisco is 1.00
States Tesla RMS in San Francisco is 0.67
States Waymo RMS in Sacramento is 1.00
States Cruise RMS in Sacramento is 0.50
States that AmensaDrive operates in one out of the three provided cities