APEX-Agents · Law
World434_JS_03
APEX-Agents task World434_JS_03 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
During acquisition diligence, Apex Storage Asia Pte. Ltd. (the "Landlord") notifies of a claim it has just received from a tenant. The Landlord has a lease for part of one of its Singapore properties (the "Premises") with We Love Bicycles, Inc. (the "Tenant"). The Premises consists of three floors. The Tenant has a four-year lease agreement for the Premises uses the first floor of the Premises as a bike shop and the second and third floors as rentable bike storage units. One month after entering into the lease agreement, the Tenant was informed by Singapore authorities that the second and third floors of the Premises were unlawfully constructed and cannot be used. The lease agreement does not warrant that the second and third floors of the Premises were lawfully constructed. The Tenant immediately sued for breach of contract requesting damages and the right to terminate the lease. Determine whether the Tenant will be entitled to terminate the lease agreement. Provide an explanation to me right here, describing your view.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/3 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States there is an implied term of lawful use in the lease
States that the Landlord committed a repudiatory breach of the lease agreement
States that the Tenant will be entitled to terminate the lease agreement