Raycaster/ Eval

APEX-Agents · Management Consulting

World 135_CD_01

Best published3/3Pass

APEX-Agents task World 135_CD_01 in AI Agents for Consumer Growth Strategy. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Consumer Growth StrategyManagement Consulting World 135Dual harnessGrader: rubric
task_e8b80949477a401cafb325db4956e5cb
Management Consulting World 135
message_in_console
5 models · dual config

Task prompt

What the agent was asked to do

Which product has the highest DTC conversion rate, defined as units sold divided by views on website across all quarters? What was its conversion rate, rounded to two decimal places? Assuming no change in website views, how many units of this product would Lumea need to sell in order to reach an average conversion rate across all products of 8.5%? Use the Q1-Q4 DTC performance files for the analysis. Return your final outputs as a message right in here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3.1 Produal3/3Pass
GPT-5.4dual2/3Fail
GPT-5.4 minidual1/3Fail
GPT-5.4 nanodual1/3Fail
GPT-5.5dual1/3Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that the product with the highest conversion rate is AuraShield Mineral SPF

  2. States that the conversion rate of the highest conversion product is 12.66%

  3. States the amount of highest conversion product Lumea needs to sell to reach an average conversion rate of 8.5% is 416,429 units