APEX-Agents · Management Consulting
World 131_MK_Task 4
APEX-Agents task World 131_MK_Task 4 in AI Agents for Legal Contract Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Please calculate how much Germany's and Netherlands' renewables pipelines (will be only 95%) will cover out of their total yearly loads in 2027 and 2028 in % terms. You can use their average historical total load data as the estimate for future needs. Output the year and coverage percentage. Return it as a short message to me here. Round the final percentage values to 0.01%.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 0/4 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/4 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/4 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/4 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/4 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States Germany's 2027 renewables % of total load is 0.67%
States Germany's 2028 renewables % of total load is 0.83%
States Netherland's 2027 renewables % of total load is 3.92%
States Netherland's 2028 renewables % of total load is 4.92%