APEX-Agents · Law
World434-TK-01
APEX-Agents task World434-TK-01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Post-closing, the Fire Department issued a fine for pre-completion non-compliance at one of the facilities, and the buyer paid the fine to avoid operational disruption. Take a look at the Secure Box SPA indemnity structure. Can we recover that amount from the seller under the specific indemnity, or is there a Hong Kong public-policy issue with indemnifying regulatory penalties? I want to know whether the indemnity in the contract works or whether this is a gap. Summarize your answers briefly and reply with a message here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/3 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 1/3 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/3 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 1/3 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/3 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that under Hong Kong law, there is no public-policy prohibition on indemnification between private parties
States that the SPA directs the seller to reimburse the buyer for a loss suffered as a result of a pre-completion non-compliance fine
States that the indemnity works as drafted, under Hong Kong law