Raycaster / evalsBack to AI Agents for Employment Law Analysis

APEX-Agents · Law

World417_TS_03

1/7Fail

APEX-Agents task World417_TS_03 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Employment Law AnalysisLaw World 417Dual harnessGrader: rubric
task_7a9c79c92d95434cb642ef8c3cccfc60
Law World 417
message_in_console
6 models · dual config

Task prompt

What the agent was asked to do

Our client, Chasing Streams, LLC, needs to know whether or not it might be liable to either or both employees who filed suit against it for violation of the California and/or Federal WARN Act. Please juxtapose the provisions of the Act to the company files. Write your reply back to me so I can decide next steps.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual1/7Fail
fireworks models Kimi K2dual0/7Fail
Gemini 3.1 Produal3/7Fail
GPT-5.4dual0/7Fail
GPT-5.4 minidual0/7Fail
GPT-5.4 nanodual1/7Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that the Federal WARN Act requires companies to provide employees of six months or more, who will be affected by a mass layoff, a notice that is dated at least 60 days prior to the termination date

    Fail

    Evidence: The response says Federal WARN requires notice to affected employees and others, quoting that an employer may not order a mass layoff until after “a 60-day period” following written notice. It also discusses federal thresholds excluding part-time employees. Assessment: The criterion requires stating notice to employees “of six months or more” affected by a mass layoff, dated at least 60 days before termination. The response covers affected employees and 60 days, but does not state the six-month-employment requirement. Fail.

  2. States that the California WARN Act requires companies to provide employees of six months or more, who will be affected by a mass layoff, a notice that is dated at least 60 days prior to the termination date

    Fail

    Evidence: The response says California WARN “requires notice 60 days before a mass layoff” and quotes that an employer may not order a mass layoff unless “60 days before the order takes effect” it gives written notice. Assessment: The criterion requires stating California WARN notice is required for employees “of six months or more” affected by a mass layoff. The response does not mention the six-month-employment component. Fail.

  3. States that William Ito's notice complied with the requirements of both Acts

    Pass

    Evidence: The response states: “Ito’s file supports a full 60-day notice period,” and under application: “Ito’s notice is dated ‘October 5, 2024’ for a December 4, 2024 separation. October 5 to December 4 is 60 days. If Chasing Streams can prove service on October 5, Ito’s WARN timing claim is weak.” Assessment: The criterion asks whether the response states Ito’s notice complied with both Acts. The response clearly conveys that Ito’s notice meets the 60-day timing requirement, albeit with a proof-of-service caveat, and discusses both federal and California 60-day requirements. Pass.

  4. States that Streams cannot be held liable for William Ito's termination under the Federal WARN Act

    Fail

    Evidence: The response says “Ito as defensible if we can produce proof that his October 5 notice was actually served” and “If Chasing Streams can prove service on October 5, Ito’s WARN timing claim is weak.” Assessment: The criterion requires stating Streams cannot be held liable for Ito’s termination under Federal WARN. The response does not make that categorical conclusion; it qualifies non-liability on proof of service and only says the claim is weak/defensible. Fail.

  5. States that Streams cannot be held liable for William Ito's termination under the California WARN Act

    Fail

    Evidence: The response says “Ito’s file supports a full 60-day notice period” and recommends treating “Ito as defensible if we can produce proof that his October 5 notice was actually served.” Assessment: The criterion requires stating Streams cannot be held liable for Ito’s termination under California WARN. The response does not expressly state no California liability; it gives a conditional defense based on proof of service. Fail.

  6. States that Streams cannot be held liable for Yvonne Sanchez' termination under the Federal WARN Act

    Fail

    Evidence: The response says “The stronger liability exposure appears to be to Sanchez,” “Sanchez has a facial five-day WARN shortfall,” and “I would treat Sanchez as a real but potentially modest individual WARN exposure unless we can prove she also received the October 5 notice.” Assessment: The criterion requires stating Streams cannot be held liable for Sanchez’s termination under Federal WARN. The response states the opposite/qualified exposure. Fail.

  7. States that Streams cannot be held liable for Yvonne Sanchez' termination under the California WARN Act

    Fail

    Evidence: The response says Sanchez’s notice was only 55 days before separation and “Sanchez has a facial five-day WARN shortfall,” with “real but potentially modest individual WARN exposure unless” timely notice can be proved. Assessment: The criterion requires stating Streams cannot be held liable for Sanchez’s termination under California WARN. The response does not state no liability and instead identifies likely exposure. Fail.