APEX-Agents · Law
World416_JS_01
APEX-Agents task World416_JS_01 in AI Agents for Tariff and Trade Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a Complaint against United States President Donald Trump (the "Defendant") in the United States District Court for the District of Columbia challenging a 30% tariff that the Defendant imposed on imports for metals that the Plaintiff uses in manufacturing. The Plaintiff has claimed that the International Emergency Economic Powers Act ("IEEPA") does not grant the Defendant to impose tariffs. The Defendant has moved to transfer the action to the Court of International Trade. The case has been assigned to Judge Rudolph Contreras. Will the motion be granted? Give me a reply with a yes or no answer and a single sentence explanation.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 2/2 | Pass | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 2/2 | Pass | Share pagePublic trace |
| Gemini 3 Flash | dual | 2/2 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 0/2 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States No, the Motion to Transfer will not be granted
PassEvidence: TEXT_RESPONSE says, "No — Judge Contreras would likely deny transfer..." Assessment: The criterion requires stating "No, the Motion to Transfer will not be granted"; pass because the response clearly says no and that transfer would likely be denied.
States that the Court of International Trade does not have jurisdiction over the claim
PassEvidence: TEXT_RESPONSE says "the Court of International Trade would not have exclusive jurisdiction." Assessment: The criterion requires stating that the Court of International Trade does not have jurisdiction over the claim; pass because the response states the CIT would not have jurisdiction as the basis for denying transfer, albeit phrased as not having exclusive jurisdiction.