APEX-Agents · Management Consulting

World 134_RG_02

0/1Fail

APEX-Agents task World 134_RG_02 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 134Dual harnessGrader: rubric

Task IDtask_749eeedb6a2b4a8a98ddd46fed5ac7b7

WorldManagement Consulting World 134

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

Calculate overall customer sentiment score using the customer surveys. For each section, compute the section sentiment score as the simple average of the available question-level scores within that section (omit any question with missing scores). Then, calculate the customer sentiment score as the weighted average of all section sentiment scores, using the weights specified in the chart from the attached score guide. For the NPS score, adjust for the scale difference by using 50% of the average NPS value before including it in the weighted aggregation. Round your final answer to 4 decimal places, and reply back to me with it here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	0/1	Fail	Share page Public trace
Gemini 3.1 Pro	dual	0/1	Fail	Share page Public trace
GPT-5.4	dual	0/1	Fail	Share page Public trace
GPT-5.4 mini	dual	0/1	Fail	Share page Public trace
GPT-5.4 nano	dual	0/1	Fail	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States that the overall customer sentiment score is 3.1129
Fail
Evidence: <TEXT_RESPONSE> is "2.9276". Assessment: The criterion requires the response to state that the overall customer sentiment score is 3.1129; it instead states 2.9276, so this fails.