Raycaster / evalsBack to AI Agents for M&A Legal Due Diligence

APEX-Agents · Management Consulting

World132_DA_Task07

0/1Fail

APEX-Agents task World132_DA_Task07 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 132Dual harnessGrader: rubric
task_9e9514d5f4914c8fabe9734b242aed3a
Management Consulting World 132
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Using the McKinsey wellness report and our buyer profile analysis, recalculate Supplement pricing with two factors only: Vitamins and Supplements preference and increased spending. Apply as multipliers to base the current recommended base premium %. Show the new recommended price The final answer should be formatted to US$, rounded to 2 decimal points. Write it out here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/1Fail
Gemini 3.1 Produal0/1Fail
GPT-5.4dual0/1Fail
GPT-5.4 minidual0/1Fail
GPT-5.4 nanodual0/1Fail

Grading rubric

Criteria and grader verdict (showcase run)

  1. States the New Recommended Supplement Price is $42.83

    Fail

    Evidence: <TEXT_RESPONSE> says “US$35.25.” Assessment: Criterion requires the response to state the New Recommended Supplement Price is $42.83; it instead gives $35.25, so this fails.