APEX-Agents · Law
World416_JS_01
APEX-Agents task World416_JS_01 in AI Agents for Tariff and Trade Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a Complaint against United States President Donald Trump (the "Defendant") in the United States District Court for the District of Columbia challenging a 30% tariff that the Defendant imposed on imports for metals that the Plaintiff uses in manufacturing. The Plaintiff has claimed that the International Emergency Economic Powers Act ("IEEPA") does not grant the Defendant to impose tariffs. The Defendant has moved to transfer the action to the Court of International Trade. The case has been assigned to Judge Rudolph Contreras. Will the motion be granted? Give me a reply with a yes or no answer and a single sentence explanation.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 2/2 | Pass | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States No, the Motion to Transfer will not be granted
States that the Court of International Trade does not have jurisdiction over the claim