APEX-Agents · Law
World418-Tk-03
APEX-Agents task World418-Tk-03 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
BlueLNG sued Nakamura in the Southern District of New York based on the shipbuilding contract. Given that Nakamura has no office in the district, can BlueLNG seek Rule B attachment of a US$ wire transfer sent from Nakamura to Obun Corporation with Head Office in Manhattan and attachment of 15,000 Maersk shares owned by Nakamura held by Cantor Fitzgerald's office on Wall Street? Please answer me with a reply here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 2/2 | Pass | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 1/2 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that BlueLNG cannot obtain Rule B attachments for the wire transfer
States that BlueLNG cannot obtain Rule B attachments for the shares in the Southern District of New York