APEX-Agents · Law
World431_AVK_03
Best published2/2Pass
APEX-Agents task World431_AVK_03 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models, scores, and public traces.
AI Agents for Real Estate Lease ReviewLaw World 431Dual harnessGrader: rubric
Task prompt
What the agent was asked to do
Review the attached documents to determine the amounts to be distributed from AI Automation Group, LLC ("AIAG") to Shohei Yamamoto and Janet Swift. Get me your reply right back here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/2 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the amount to be distributed to Shohei Yamamoto is $20,000
States that the amount to be distributed to Janet Swift is $5,000