Raycaster / evalsBack to AI Agents for Employment Law Analysis

APEX-Agents · Law

World417_TG_03

1/1Pass

APEX-Agents task World417_TG_03 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Employment Law AnalysisLaw World 417Dual harnessGrader: rubric
task_2f209bd1a8974f5fad59377f8e315910
Law World 417
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

In preparation for ParaZon's HSR submission, please review the email exchange between it and ChasingStreams, its lost aircraft memo, and its member admission memo. Identify which of these files is required for submission by ParaZon pursuant to the attached Federal Trade Commission HSR Form Updates. Reply to me with your findings as a message here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual1/1Pass
fireworks models Kimi K2dual1/1Pass
Gemini 3 Flashdual0/1Fail
Gemini 3.1 Produal0/1Fail
GPT-5.4dual1/1Pass
GPT-5.4 minidual1/1Pass
GPT-5.4 nanodual0/1Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that none of the documents from the list provided constitutes a Transaction-Related Document required to accompany ParaZon's submission of the Federal Trade Commission's Acquiring Person Notification and Report Form for its acquisition of ChasingStreams

    Pass

    Evidence: TEXT_RESPONSE states, “None of the three reviewed categories of files is required to be submitted by ParaZon as an HSR document attachment,” and “Do not include these files as required HSR attachments.” It further says the email exchange is “not a transaction-related competition document of the type that must be submitted.” Assessment: The criterion asks whether the response states that none of the listed documents constitutes a Transaction-Related Document required to accompany ParaZon’s FTC Acquiring Person Notification and Report Form submission. This is clearly conveyed; pass.