Raycaster/ Eval

APEX-Agents

GPT-5.4 on LawWorld433_ANB_03

2/3Fail
Domain
Law
Category
AI Agents for Healthcare and Senior Living Legal Risk
Harness
dual

Grader rubric

Criteria verdict

  1. States No, 15A NCAC 18A .1600 does not apply to Magnolia Gardens' North Carolina facilities

  2. States that 15A NCAC 18A .1600 does not apply to an adult care home with 13 or more residents

  3. States that in North Carolina, Magnolia Gardens facilities have 20-30 residents

Prompt excerpt

Task context

Does 15A NCAC 18A .1600 apply to food service in Magnolia Gardens' North Carolina facilities? Create a new documents document and respond in there.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.