APEX-Agents · Law

Task yhzc9d1a

5/5Pass

APEX-Agents task Task yhzc9d1a in AI Agents for SEC Disclosure Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for SEC Disclosure AnalysisLaw World 415Dual harnessGrader: rubric

Task IDtask_107a64a2aeb8439fb41c5e16d25a5326

WorldLaw World 415

Expected outputmake_new_sheet

Published runs7 models · dual config

Task prompt

What the agent was asked to do

CrowdStrike sent the attached list of historic stock transactions (note the document lists transactions for both Class A and B stocks). We need to determine if any of these people would be a part of the class in the Plymouth County lawsuit, assuming no opt-outs. Look for the class requirements and the attached list of transactions, identify which individuals from the upload purchased Class A stock, and which of those did so during the Class Period to qualify for the class. Make a new sheet and list their names and each transaction for which the individual qualifies.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	5/5	Pass	Share page Public trace
fireworks models Kimi K2	dual	5/5	Pass	Share page Public trace
Gemini 3 Flash	dual	5/5	Pass	Share page Public trace
Gemini 3.1 Pro	dual	5/5	Pass	Share page Public trace
GPT-5.4	dual	5/5	Pass	Share page Public trace
GPT-5.4 mini	dual	5/5	Pass	Share page Public trace
GPT-5.4 nano	dual	5/5	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States that Michael Lawson made a Class A Stock Purchase on 11/30/2023
Pass
Evidence: In `/root/workspace/filesystem/Stock Transactions - Historic.xlsx`, page/sheet `Plymouth County CrowdStrike Class — Qualifying Transactions` lists `Michael Lawson` with `Class A*`, `Purchase`, trade date `11/30/2023`. Assessment: Criterion requires stating Michael Lawson made a Class A Stock Purchase on 11/30/2023; pass.
States that Larry Stone made a Class A Stock Purchase on 4/3/2024
Pass
Evidence: The new qualifier sheet in `/root/workspace/filesystem/Stock Transactions - Historic.xlsx` lists `Larry Stone` with `Class A*`, `Purchase`, trade date `4/3/2024`. Assessment: Criterion requires stating Larry Stone made a Class A Stock Purchase on 4/3/2024; pass.
States that Geralt Tribeard made a Class A Stock Purchase on 7/28/2024
Pass
Evidence: The new qualifier sheet in `/root/workspace/filesystem/Stock Transactions - Historic.xlsx` lists `Geralt Tribeard` with `Class A*`, `Purchase`, trade date `7/28/2024`. Assessment: Criterion requires stating Geralt Tribeard made a Class A Stock Purchase on 7/28/2024; pass.
States that Susan Willow made a Class A Stock Purchase on 2/7/2024
Pass
Evidence: The new qualifier sheet in `/root/workspace/filesystem/Stock Transactions - Historic.xlsx` lists `Susan Willow` with `Class A*`, `Purchase`, trade date `2/7/2024` (and another qualifying 7/7/2024 purchase). Assessment: Criterion requires stating Susan Willow made a Class A Stock Purchase on 2/7/2024; pass.
States that Rayland Givens made a Class A Stock Purchase on 7/5/2024
Pass
Evidence: The new qualifier sheet in `/root/workspace/filesystem/Stock Transactions - Historic.xlsx` lists `Rayland Givens` with `Class A*`, `Purchase`, trade date `7/5/2024`. Assessment: Criterion requires stating Rayland Givens made a Class A Stock Purchase on 7/5/2024; pass.