APEX-Agents · Management Consulting
World126_EFA_01
APEX-Agents task World126_EFA_01 in AI Agents for ESG and Climate Risk Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Based on Planet Defense's climate risk data and their scoring methodology, give me the top 3 sub-regions by overall risk score and their overall risk scores. Once you've done that, calculate for each continent the average overall risk score and the standard deviation of all the overall risk scores. Report numeric final answers to 2 decimal places. Write your answer here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 9/10 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 9/10 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 9/10 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 9/10 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 8/10 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the overall risk score of the sub-region with the highest overall risk score is 83.70
States that the overall risk score of the sub-region with the second-highest overall risk score is 83.55
States that the overall risk score of the sub-region with the third-highest overall risk score is 75.30
States that North America's average overall risk score is 54.69
States that South America's average overall risk score is 63.97
States that Europe's average overall risk score is 41.95
States that Africa's average overall risk score is 73.95
States that Asia's average overall risk score is 67.80
States that Oceania's average overall risk score is 59.81
States that the standard deviation across all sub-regions is 15.18