Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 mini · dual

LawWorld433_ANB_04

1/3Fail

GPT-5.4 mini on APEX-Agents: LawWorld433_ANB_04 (dual harness). Browse score, rubric, and public trace.

1/3 · Fail
Law
AI Agents for Healthcare and Senior Living Legal Risk
Law World 433

Grader rubric

Criteria verdict

  1. States that for purposes of writing professional liability insurance for healthcare providers, an insurance company may not consider the extent to which a health care provider provides services to individuals who are recipients of Medicaid

  2. States that for purposes of Title 10 §1901 of the Texas Insurance Code, an assisted living facility is considered a medical provider

  3. States “No”, Magnolia Gardens does not have to provide documentation on its number of Medicaid patients to its insurer

Prompt excerpt

Task context

Magnolia Gardens is looking to renew its 2025 coverage through Valiant Assurance Ltd. for 2026, in Texas. Valiant has asked for a list including the number of patients they serve that utilize Medicaid. Does Magnolia Gardens have to provide this information? State your view as a Yes or No, with a two-sentence explanation. Put it in a NEW documents document for me.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace