Raycaster/ Eval

APEX-Agents · Management Consulting

W132_Task01_DA

Best published7/8Fail

APEX-Agents task W132_Task01_DA in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for M&A Legal Due DiligenceManagement Consulting World 132Dual harnessGrader: rubric
task_1ecba15d0ac14cb6bb0ebb5b372b2a89
Management Consulting World 132
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Calculate and report the following metrics: 1. The Overall Vitamins Purchase Intent Score for each buyer segment. 2. The buyer segment with the highest average purchase intent score for Vitamins 3. The Vitamin Purchase Intent Index 4. Whether the Vitamin Purchase Intent Index Rating is desirable or undesirable Vitamin Purchase Intent Index is a composite metric calculated as: Average of Vitamins Purchase Intent Score across all segments × Segment Weight (i.e., Average of Population Size of buyer segment with highest purchase intent score for Vitamins × Average of Loyalty Score of buyer segment with highest purchase intent score for Vitamins) x PureLife Awareness Factor (i.e., Survey Respondents who said ‘Definitely yes’ or ‘Probably yes’ to trying PureLife divided by total Survey Respondents who have heard about PureLife). Vitamin Purchase Intent Index Rating is determined as: Vitamin Purchase Intent Index of >=8 is considered 'Desirable' other wise is considered 'Undesirable'. Base your analysis off the survey data and buyer behaviour data. Percentage values must be formatted to the nearest 0.01%. Dollar values must be formatted as US$ with 2 decimal places All other number calculations should be formatted to two decimals. Post your answer straight here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal7/8Fail
GPT-5.4 nanodual7/8Fail
GPT-5.5dual7/8Fail
GPT-5.4dual6/8Fail
GPT-5.4 minidual6/8Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States the Active Lifestyle - Purchase Intent Score for Vitamins is 5.82

  2. States the Fitness Enthusiasts - Purchase Intent Score for Vitamins is 6.33

  3. States the Health-Conscious - Purchase Intent Score for Vitamins is 6.29

  4. States the Preventive Care - Purchase Intent Score for Vitamins is 6.15

  5. States the Weight Management - Purchase Intent Score for Vitamins is 6.27

  6. States that the buyer segment with the highest average purchase intent score for Vitamins is Fitness Enthusiasts

  7. States the Vitamin Purchase Intent Index is 10.76

  8. States the Vitamin Purchase Intent Index Rating is Desirable