APEX-Agents · Law
LawWorld417_NE_06
APEX-Agents task LawWorld417_NE_06 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
We will layoff our Head of Production Sarah Rodriguez as part of the upcoming merger. Please review Section IV of Sarah's layoff and WARN Notice and let me know if the language violates WARN. Answer to me right back here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/6 | Fail | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 4/6 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 4/6 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/6 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 4/6 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/6 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 2/6 | Fail | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the language in Section IV presents issues regarding potential remedies
PassEvidence: The response says, “Section IV does not independently violate WARN, but it should be revised if the intent is to satisfy WARN obligations,” and cautions “Do not treat the delayed severance as a WARN substitute.” Assessment: The criterion asks whether it states Section IV presents issues regarding potential remedies. Pass: the response identifies remedial/severance-related risk if Section IV is intended to satisfy WARN obligations, though phrased as a caution rather than a direct violation.
States that the attempt to use a pre-existing contractual obligation to offset potential WARN Act penalties is problematic
FailEvidence: The response says, “Do not treat the delayed severance as a WARN substitute” and “if Streams is relying on severance/pay-in-lieu to address a short WARN notice period, Section IV is too vague and risky.” Assessment: The criterion asks whether it states that using a pre-existing contractual obligation to offset WARN penalties is problematic. Fail: it flags severance-as-substitute risk generally, but does not state the key issue that the severance is a pre-existing contractual obligation being used to offset WARN penalties.
States that the WARN Act (29 U.S.C. § 2104(a)(2)) allows offsets only for voluntary and unconditional payments not required by a pre-existing legal obligation
FailEvidence: The response mentions the WARN 60-day notice requirement and says Section IV does not state WARN pay/benefits, but it does not cite or describe 29 U.S.C. § 2104(a)(2). Assessment: The criterion asks whether it states that WARN allows offsets only for voluntary and unconditional payments not required by a pre-existing legal obligation. Fail: that statutory offset rule is absent.
States that because the notice specifies severance "as outlined in your employment agreement," it is a pre-existing obligation
FailEvidence: The response says Sarah’s severance “will be paid under her employment agreement” and quotes the delayed payment date, but concludes only that “severance timing is not a WARN notice-content violation by itself.” Assessment: The criterion asks whether it states that because the notice specifies severance “as outlined in your employment agreement,” it is a pre-existing obligation. Fail: the response notes an employment agreement but does not draw the required conclusion that this makes the severance a pre-existing obligation.
States that an employer cannot unilaterally terminate health care continuation rights based solely on internal restructuring
FailEvidence: The response discusses “COBRA information” and recommends language preserving “WARN-required notice, pay, benefits continuation,” but does not address unilateral termination of health care continuation rights. Assessment: The criterion asks whether it states an employer cannot unilaterally terminate health care continuation rights based solely on internal restructuring. Fail: no such statement appears.
States that the health coverage statement which says health care continues "unless changes in plan eligibility occur earlier as a result of restructuring" could misrepresent employees' rights
FailEvidence: The response references final wages/PTO/COBRA generally and says Section IV addresses “COBRA,” but does not quote or analyze the clause “unless changes in plan eligibility occur earlier as a result of restructuring.” Assessment: The criterion asks whether it states that this health coverage statement could misrepresent employees’ rights. Fail: the response does not identify this clause or the misrepresentation concern.