Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · fireworks models Kimi K2 · dual

World420_RO_01

1/3Fail

fireworks models Kimi K2 on APEX-Agents: World420_RO_01 (dual harness). Browse score, rubric, and public trace.

1/3 · Fail
Law
AI Agents for FDA and Pharma Promotional Compliance
Law World 420

Grader rubric

Criteria verdict

  1. States Bencontra has a boxed warning

  2. States Livyra can make a reminder advertisement using only the drug's name and price

  3. States that it must meet all of the conditions contained in 21 CFR 200.200

Prompt excerpt

Task context

Livyra wants to market Bencontra using just its name and price. What is the correct type of advertisement Livyra can make, if any, and what conditions must the advertisement meet? Answer in one sentence as a message in console. Use the folder Bencontra Data, the folder Legal Authorities, and "21 CFR Part 202.pdf" in your analysis.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace