APEX-Agents · Law
World433_JS_01
APEX-Agents task World433_JS_01 in AI Agents for Healthcare and Senior Living Legal Risk. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Magnolia Gardens has a contract with the Texas Department of Human Services (DHS) to provide services, as an assisted living facility, to DHS clients. Gregory Johns--a disabled DHS client who is in a wheelchair, epileptic, and blind--has recently been admitted to Magnolia Gardens and has been charged a small pet deposit for his dog, Courage. Courage is Mr. Johns' emotional support animal. Is Magnolia Gardens in compliance with Chapter 276 of Title 26 of the Texas Administrative Code in regards to charging Gregory Johns a pet deposit? Reply to me right here with a clear answer, and explain your reasoning.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States Yes, Magnolia Gardens is in compliance with Chapter 276 of Title 26 the Texas Administrative Code as to the pet deposit
States that Gregory Johns's dog, Courage, is not a service animal under Chapter 276 of Title 26 of the Texas Administrative Code
States that Magnolia can charge a pet deposit for pets that are not service animals