APEX-Agents · Law
Task vao7e9fb
APEX-Agents task Task vao7e9fb in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
One of BLPL's employees developed a long-term illness due to toxin exposure from cleaning up the oil that spilled in the M/V Red Room incident. The employee has sued BLPL for damages. If BLPL is liable for the employee's damages, will this be covered by their insurance policy? Write back your findings with a short reply to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/1 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 0/1 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/1 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States No, the employee's damages would not be covered under BLPL's insurance policy