APEX-Agents · Law
Task 5vd1ebb0
APEX-Agents task Task 5vd1ebb0 in AI Agents for SEC Disclosure Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We've received the attached warranty claims for some of our products. Please review them. Then, edit the existing existing "product purchases" spreadsheet to show the maximum refund amount a customer could receive for each product purchased.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 5/5 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 5/5 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 5/5 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 5/5 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 5/5 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 5/5 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 5/5 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States Falcon Prevent's Max Refund Amount is $0.00
States Falcon Query's Max Refund Amount is $16,888.89
States Falcon X Elite's Max Refund Amount is $0.00
States Falcon Cloud Workload Protection's Max Refund Amount is $0.00
States Falcon Container Senor's Max Refund Amount is $0.00