APEX-Agents · Law
LawWorld417_AB_01
APEX-Agents task LawWorld417_AB_01 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We are working on the Angeles case. He is the custodian who sued Chasing Streams under the ADA based on his termination and failure to accommodate. It's the one where he made a verbal request, but Chasing Streams never addressed it. What are our chances on a motion to dismiss? Explain why. Give your reply here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 1/7 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 1/7 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 1/7 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/7 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/7 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/7 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/7 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that Chasing Streams will be successful in its motion to dismiss
States that Angeles was terminated
States that on termination Angeles immediately filed his lawsuit against Chasing Streams
States that the ADA and its implementing regulations require a plaintiff to obtain a "right to sue" letter before they can file suit
States that in order to obtain a "right to sue" letter, a plaintiff must file a charge of discrimination with the EEOC or the state/local agency
States that Angeles did not file a charge of discrimination with the EEOC or state/local agency
States that Angeles did not obtain a "right to sue" letter