APEX-Agents · Law
World434_IG_01
APEX-Agents task World434_IG_01 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We had a number of compliance memoranda drafted regarding our ongoing acquisition of the storage facility companies. For the third memo listed in the compendium, do we have to comply with all the laws that are discussed for our acquisition of Secure Box? If at least some laws apply, state which ones do. Write your reply to me in here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 3/3 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that not all laws discussed in the third memo need to be complied with in the acquisition of Secure Box
States that the acquisition must comply with Hong Kong law titled Conveyancing and Property Ordinance to the extent that real property interests are included in the acquisition
States that the acquisition must comply with Hong Kong law titled Bills of Sale Ordinance to the extent that moveable assets are included in the acquisition