Raycaster/ Eval

APEX-Agents · Law

LawWorld433_ANB_02

Best published4/4Pass

APEX-Agents task LawWorld433_ANB_02 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Employment Law AnalysisLaw World 433Dual harnessGrader: rubric
task_b15e945697824a9ab869c8e9a402f5c1
Law World 433
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Jennifer Love was the nurse assigned to Mr. Buchanan's floor, and was later designated as the corporate designee of Magnolia Gardens Inc during depositions. She is called by Magnolia Gardens Inc., to testify in the wrongful death case against Magnolia Gardens Inc. Can Jennifer testify as to statements made by Tom Buchanan? Write out your reply to me in here with everything I requested.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5dual4/4Pass
Gemini 3 Flashdual3/4Fail
GPT-5.4 nanodual2/4Fail
GPT-5.4dual1/4Fail
fireworks models Kimi K2dual0/4Fail
Gemini 3.1 Produal0/4Fail
GPT-5.4 minidual0/4Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States No, Jennifer Love cannot testify regarding statements made by Tom Buchanan

  2. States that the Dead Man's Act statute precludes a person testifying on behalf of an interested party from testifying to statements made by a deceased individual

  3. States that Magnolia Gardens is a party in interest in the wrongful death suit

  4. States that Jennifer Love testimony would be on behalf of Magonia Gardens, an interested party