APEX-Agents · Management Consulting

World125_Task01_NA

4/4Pass

APEX-Agents task World125_Task01_NA in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Cross-Border Regulatory ReviewManagement Consulting World 112.1Dual harnessGrader: rubric

Task IDtask_dbf1b00ea3cc4a59af744f370f7a1acf

WorldManagement Consulting World 112.1

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

Using the 2024 annual report, identify whether Impact Therapeutics sells primarily branded drugs. A company sells primarily branded drugs if the majority of drugs have launch dates within the last 7 years. Please use the BCG report to determine the average COGS as a % of revenue for competitors in Impact Therapeutics' segment, based on whether they sell primarily generic drugs, branded, or a mix. Round to the nearest %. In both the global and US geos, state whether Impact Therapeutics is above the segment average calculated from the data in the BCG report. Write your response as a reply to me here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	4/4	Pass	Share page Public trace
Gemini 3.1 Pro	dual	4/4	Pass	Share page Public trace
GPT-5.4	dual	4/4	Pass	Share page Public trace
GPT-5.4 mini	dual	4/4	Pass	Share page Public trace
GPT-5.4 nano	dual	4/4	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States that Impact Therapeutic is a company that primarily sells branded drugs
Pass
Evidence: TEXT_RESPONSE says “Impact Therapeutics **does primarily sell branded drugs**” and explains it counted 2018–2024 launches. Assessment: Criterion asks whether it states Impact Therapeutic primarily sells branded drugs; pass.
States the average of COGS as a share of revenue for companies that primarily sell branded drugs is 23%
Pass
Evidence: TEXT_RESPONSE table lists “Primarily branded | 23%” and says “the relevant BCG peer average is **23%**.” Assessment: Criterion asks whether it states average COGS/revenue for primarily branded companies is 23%; pass.
States that the global COGS as a share of revenue for Impact Therapeutics in 2024 is higher than the average of 23%
Pass
Evidence: TEXT_RESPONSE table lists “Global | 30% | 23% | **Yes**” and says global COGS “about 30% in 2024.” Assessment: Criterion asks whether it states global COGS/revenue for Impact in 2024 is higher than 23%; pass.
States that the US COGS as a share of revenue for Impact Therapeutics in 2024 is higher than the average of 23%
Pass
Evidence: TEXT_RESPONSE table lists “U.S. | 31% | 23% | **Yes**.” Assessment: Criterion asks whether it states US COGS/revenue for Impact in 2024 is higher than 23%; pass.