APEX-Agents · Management Consulting
World135_KS_Task 3
APEX-Agents task World135_KS_Task 3 in AI Agents for Hospitality Loyalty Strategy. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Use the State of Fashion Beauty report for June 2025 to identify which 3 countries have the most customer engagement in live social media shopping events, measured by the percentage of customers who have ever attended a beauty live shopping show. Calculate the percentage of customers who have ever engaged in live shopping shows in these 3 countries, and then state the percentage of customers who have ever engaged in live shopping shows in the US. Round answers to the nearest whole percent and do not round any intermediate calculations Respond with your findings in a new document that you create.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 7/7 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 7/7 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 7/7 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 7/7 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 7/7 | Pass | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States one the 3 countries with the most engagement in live social media shopping events measured by the percentage of customers who have ever attended a beauty live shopping show is China
States one the 3 countries with the most engagement in live social media shopping events measured by the percentage of customers who have ever attended a beauty live shopping show is India
States one the 3 countries with the most engagement in live social media shopping events measured by the percentage of customers who have ever attended a beauty live shopping show is Korea
States the total percentage of customers who have ever engaged in live shopping shows in China is 64%
States the total percentage of customers who have ever engaged in live shopping shows in India is 50%
States the total percentage of customers who have ever engaged in live shopping shows in Korea is 38%
States the total percentage of customers who have ever engaged in live shopping shows in US is 22%