APEX-Agents · Law
World433_JS_04
APEX-Agents task World433_JS_04 in AI Agents for Healthcare and Senior Living Legal Risk. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Magnolia Gardens has Adult Care Home facilities in North Carolina. One of the North Carolina Adult Care Home facilities has 25 residents. It has a 400-square-foot enclosed indoor recreational area in the center of the single building facility. Does the recreational area comply with Title 10A, Subchapter 13F, Section .0305 of the North Carolina Administrative Code (10A NCAC 13F .0305)? Provide an answer with a single-sentence explanation.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/2 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that Title 10A, Chapter 13F, section .0305 of the North Carolina Administrative Code provides that recreational areas must have windows with views to the outside
States that the recreational area does not comply with 10A NCAC 13F .0305