Raycaster/ Eval

APEX-Agents

gpt-5.4-nano on LawWorld433_NAF_01

1/5Fail
Domain
Law
Category
AI Agents for Healthcare and Senior Living Legal Risk
Harness
dual

Grader rubric

Criteria verdict

  1. States that Heather Collins cannot legally allow her care staff to all take naps at the same time

  2. States any of the following as the relevant law: (1) the Texas Administrative Code at section TAC 553.253(c)(4)(A); and (2) that in a large, Type A assisted living facility, night shift staff must be "immediately available and awake"

  3. States that Heather Collins manages the night shift at the Grove-Austin facility

  4. States that the Grove-Austin facility is licensed as a Type A assisted living facility under the Texas Administrative Code

  5. States that the Grove-Austin facility qualifies as a large assisted living facility under the Texas Administrative Code

Prompt excerpt

Task context

Heather Collins has started to let her care staff all take naps at the same time. Legally, can she do this? Provide me with a brief explanation of your answer, citing the relevant sources. Reply back to me with your view in here.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.