APEX-Agents · Management Consulting
World_131_JR_1
APEX-Agents task World_131_JR_1 in AI Agents for Legal Contract Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Can you please evaluate the outage causes that affect each country the most, in terms of total outage duration? Categorize hazards relating to flooding or storms as the "Weather - Storm" cause and those relating to heat or wildfire as the "Weather - Heat" cause. For France and the Netherlands, state the top weather cause by outage duration, the total events per year in that cause, and the average outage minutes per event in that cause. Note that the Outage ID doesn't reflect individual events; it can be a single event or multiple events combined. Final answers should be rounded to two decimal places. Please report your answers directly to me in here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 4/6 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 3/6 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/6 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the top weather cause by outage duration for France is Weather - Heat
States the total events per year for Weather - Heat in France is 23.42
States the average outage duration per event for Weather - Heat in France is 89.20 minutes
States the top weather cause by outage duration for the Netherlands is Weather - Storm
States the total events per year for Weather - Storm in the Netherlands is 29.26
States the average outage duration per event for Weather - Storm in the Netherlands is 90.81 minutes