APEX-Agents · Law

LawWorld433_ANB_03

Best published3/3Pass

APEX-Agents task LawWorld433_ANB_03 in AI Agents for Healthcare and Senior Living Legal Risk. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Healthcare and Senior Living Legal RiskLaw World 433Dual harnessGrader: rubric

Task IDtask_e72676c169294461adff044bee6a5587

WorldLaw World 433

Expected outputmake_new_doc

Published runs6 models · dual config

Task prompt

What the agent was asked to do

Does 15A NCAC 18A .1600 apply to food service in Magnolia Gardens' North Carolina facilities? Create a new documents document and respond in there.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5	dual	3/3	Pass	Run details Public trace
Gemini 3.1 Pro	dual	2/3	Fail	Run details Public trace
GPT-5.4	dual	2/3	Fail	Run details Public trace
fireworks models Kimi K2	dual	1/3	Fail	Run details Public trace
GPT-5.4 mini	dual	1/3	Fail	Run details Public trace
GPT-5.4 nano	dual	1/3	Fail	Run details Public trace

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

States No, 15A NCAC 18A .1600 does not apply to Magnolia Gardens' North Carolina facilities
States that 15A NCAC 18A .1600 does not apply to an adult care home with 13 or more residents
States that in North Carolina, Magnolia Gardens facilities have 20-30 residents