APEX-Agents · Law
World420_SF_02
APEX-Agents task World420_SF_02 in AI Agents for FDA and Pharma Promotional Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Livyra has decided to pay its independent contractors a fixed salary, consistent with fair market value, to sell Bencontra that is payable by government healthcare. Each independent contractor is given a written 1-year contract. Does this likely violate the anti-kickback statute? Please reply to me with a single sentence answer and explanation.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 2/2 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the independent contractor contracts likely do not violate the anti-kickback statute
States that the contracts fall under the Personal Services and Management Contracts Safe Harbor