APEX-Agents · Law
Law433_mk-01
APEX-Agents task Law433_mk-01 in AI Agents for Privacy and GDPR Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We have received a claim from Thomas Whitaker’s counsel asserting that Magnolia breached its obligations by failing to provide weekly communication to Mr. Whitaker's family. Provide the strongest argument that Magnolia has no contractual obligation to provide weekly care updates, and the family's strongest counterargument, in no more than four sentences. Reply back to me in here and describe what you find.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 4/4 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/4 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 3/4 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 3/4 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 2/4 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/4 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/4 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that Magnolia’s strongest argument is that the Residency Agreement’s Entire Agreement clause states that the written contract constitutes the parties’ entire agreement
States that there is no language in the Residency Agreement which mandates weekly communication with the family
States that the family's strongest argument is that the Residency Agreement expressly incorporates the Resident Handbook by reference, making it part of the contract in its entirety
States that Section 8 of the 2023 Resident Handbook states that families receive weekly care item reports