APEX-Agents · Law

World421_KA_01

Best published3/4Fail

APEX-Agents task World421_KA_01 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Cross-Border Regulatory ReviewLaw World 421Dual harnessGrader: rubric

Task IDtask_8dc8e0ec2a204b1ba18f068967cee6dc

WorldLaw World 421

Expected outputmessage_in_console

Published runs7 models · dual config

Task prompt

What the agent was asked to do

Would you please review the 50-State Survey of Telemarketing Laws document and identify whether or not there are any states missing from the list in the document? Then, send me the list the of missing states that have enhanced senior protections. Write out your reply in here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
Gemini 3 Flash	dual	3/4	Fail	Run details Public trace
GPT-5.4 mini	dual	3/4	Fail	Run details Public trace
GPT-5.5	dual	3/4	Fail	Run details Public trace
Gemini 3.1 Pro	dual	2/4	Fail	Run details Public trace
GPT-5.4 nano	dual	2/4	Fail	Run details Public trace
fireworks models Kimi K2	dual	1/4	Fail	Run details Public trace
GPT-5.4	dual	0/4	Fail	Run details Public trace

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

States Yes, there are states missing from the 50-State Survey of Telemarketing Laws document that have enhanced senior protection laws
States that a state with enhanced senior protection laws that is missing from the 50-State Survey of Telemarketing Laws document is Wyoming
States that a state with enhanced senior protection laws that is missing from the 50-State Survey of Telemarketing Laws document is New York
States that a state with enhanced senior protection laws that is missing from the 50-State Survey of Telemarketing Laws document is Indiana