Raycaster / evalsBack to AI Agents for Employment Law Analysis

APEX-Agents · Investment Banking

world219_tg_04

0/1Fail

APEX-Agents task world219_tg_04 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Employment Law AnalysisInvestment Banking World 219Dual harnessGrader: rubric
task_95a11015406f43a597c0b68c0b2e429a
Investment Banking World 219
message_in_console
4 models · dual config

Task prompt

What the agent was asked to do

Assume that CNS has been taken private as of the start of FY25E. The new PE owners have decided to reduce employee compensation by 50% of the value of stock-based compensation in the previous LBO forecast (when CNS was a public company). Based on this, calculate the revised DCF per share valuation of CNS. Keep all assumptions the same per the DCF base case. Provide your response right here, rounded to the nearest cent.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal1/1Pass
GPT-5.4 minidual0/1Fail
GPT-5.4 nanodual1/1Pass

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that per share DCF value is $57.54

    Fail

    Evidence: <TEXT_RESPONSE> states, “Revised DCF per share valuation: $51.97.” Assessment: The criterion requires stating that the per share DCF value is $57.54; the response gives a different value, so it fails.