APEX-Agents · Law
World416_TK_02
Best published1/1Pass
APEX-Agents task World416_TK_02 in AI Agents for Tariff and Trade Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
AI Agents for Tariff and Trade Law AnalysisLaw World 416Dual harnessGrader: rubric
Task prompt
What the agent was asked to do
TAC has just informed us that they expect a 20% drop in gross margin due to import tariffs. TAC has posted the information on their website as they have done in the past. Write me back a brief message, explaining whether this will trigger an additional 8K filing.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 1/1 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 1/1 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 0/1 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/1 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that a forward-looking tariff impact does not trigger a mandatory Form 8-K submission