APEX-Agents · Management Consulting
World132_PM_Task07
APEX-Agents task World132_PM_Task07 in AI Agents for Consumer Growth Strategy. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
We need to assess the concentration of business across players. Let us remove supplements category from the analysis. Concentration of business of a player is its % share of revenue in its top 4 markets. I need to know: 1. Which player has the lowest concentration globally and what is the concentration of its business? 2. How many players have their % share in Asia lower than 50%? Exclude players that have no presence in Asia. Report all final values here to me as a message, rounding to 2 decimal places.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 2/3 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 2/3 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the player with the lowest concentration globally is Online D2C Brand 2
PassEvidence: <TEXT_RESPONSE> says “Lowest global concentration: `Online D2C Brand 2`”. Assessment: Criterion requires stating the player with lowest concentration globally is Online D2C Brand 2; pass.
States that the concentration of business of the player with lowest concentration globally is 54.28%
PassEvidence: <TEXT_RESPONSE> says “Online D2C Brand 2 — **54.28%** of revenue in its top 4 markets.” Assessment: Criterion requires stating the concentration is 54.28%; pass.
States that when excluding players that have no presence in Asia, the number of players that have their % share in Asia lower than 50% is 8
FailEvidence: <TEXT_RESPONSE> says “Players with Asia share below 50%, excluding players with no Asia presence: **10 players**.” Assessment: Criterion requires the number to be 8; the response gives 10, so fail.