APEX-Agents · Law
World434_DPM_01
APEX-Agents task World434_DPM_01 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Review the URA Land Search Report, based on the relevant provision of the Planning Act, what is the potential maximum financial penalty regarding TOP/2018/04576 as of January 1, 2025? Assume that the sentence "[i]f the facility has been operating as self-storage since 2020 without proper approval, the cumulative exposure could be significant," is referencing January 1, 2020. Write back to me with your assessment in here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 3/3 | Pass | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the penalty on conviction is a fine not exceeding S$200,000
States that after conviction, a further fine not exceeding $10,000 applies for each day or part of a day during which the offence continues
States that the potential maximum penalty as of January 1, 2025 is $200,000