APEX-Agents · Law
World434_IG_03
APEX-Agents task World434_IG_03 in AI Agents for Real Estate Lease Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Harborview has contemplated a new spinoff transaction as outlined in the attached memorandum prepared by the CLO. Review the memorandum and explain whether Alex Morgan will be subject to reporting requirements under 31 U.S.C. § 5336. You can reply right here with a short message please.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/1 | Pass | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 0/1 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 1/1 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 0/1 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 0/1 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 0/1 | Fail | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that Alex Morgan should be reported as a beneficial owner
PassEvidence: The response states, “likely yes — Alex Morgan should be treated as a reportable beneficial owner” and “Harborview should plan to include Alex’s BOI in the entity’s CTA filing.” Assessment: The criterion asks whether it states that Alex Morgan should be reported as a beneficial owner; pass because the response clearly conveys that conclusion.