APEX-Agents · Law
World415_DM_01
APEX-Agents task World415_DM_01 in AI Agents for SEC Disclosure Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
MLT is a CrowdStrike customer severely affected by the outage. MLT filed a lawsuit for negligence seeking to recover damages arising from the outage. Additionally, MLT successfully transferred venue to Georgia. CrowdStrike is considering moving for summary judgment on the basis that the outage does not rise to the level of gross negligence and the exculpatory clause in the contract applies (the "Motion"). Can you tell me if CrowdStrike is likely to succeed in its Motion? Reply to me with your view, giving me a Yes or No and a short explanation.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 3/3 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 3/3 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States No, CrowdStrike is unlikely to succeed in its Motion
States that the determination of whether the degree of negligence amounts to gross negligence is typically a question of fact for a jury
States that gross negligence cannot be waived by an exculpatory clause under Georgia law