APEX-Agents · Management Consulting
World 134_RG_02
APEX-Agents task World 134_RG_02 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Calculate overall customer sentiment score using the customer surveys. For each section, compute the section sentiment score as the simple average of the available question-level scores within that section (omit any question with missing scores). Then, calculate the customer sentiment score as the weighted average of all section sentiment scores, using the weights specified in the chart from the attached score guide. For the NPS score, adjust for the scale difference by using 50% of the average NPS value before including it in the weighted aggregation. Round your final answer to 4 decimal places, and reply back to me with it here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 0/1 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 0/1 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the overall customer sentiment score is 3.1129