APEX-Agents · Law
LawWorld417_NE_06
APEX-Agents task LawWorld417_NE_06 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We will layoff our Head of Production Sarah Rodriguez as part of the upcoming merger. Please review Section IV of Sarah's layoff and WARN Notice and let me know if the language violates WARN. Answer to me right back here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 4/6 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 4/6 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 4/6 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/6 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/6 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/6 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 1/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the language in Section IV presents issues regarding potential remedies
States that the attempt to use a pre-existing contractual obligation to offset potential WARN Act penalties is problematic
States that the WARN Act (29 U.S.C. § 2104(a)(2)) allows offsets only for voluntary and unconditional payments not required by a pre-existing legal obligation
States that because the notice specifies severance "as outlined in your employment agreement," it is a pre-existing obligation
States that an employer cannot unilaterally terminate health care continuation rights based solely on internal restructuring
States that the health coverage statement which says health care continues "unless changes in plan eligibility occur earlier as a result of restructuring" could misrepresent employees' rights