APEX-Agents · Law
World425_RO_02
APEX-Agents task World425_RO_02 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
On 12/1/2028 our client, Summit, informed us they received a claim from Harbor Bridge for failure to disclose a phantom stock plan during the sale transaction we helped them with back in 2025. The claim is for $726,000. Can you please review the stock purchase agreement and see if this is a valid claim or not? And if so, what is Summit's total liability and how much more would they have to pay above the escrow? Give numbers rounded to 000s. Write a short response here. Assume the closing occurred on 11/1/2025 and that the claim is valid in every regard. Use only the stock purchase agreement in your analysis.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 2/3 | Fail | Run detailsPublic trace |
| Gemini 3 Flash | dual | 2/3 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/3 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/3 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the Seller's total liability is $726,000
States that the Seller's remaining liability is $301,000 plus the amount of any prior claims against the escrow account
States that the claim is allowable under Section 11.5(a)