APEX-Agents · Investment Banking
World228_JP_02
APEX-Agents task World228_JP_02 in AI Agents for FDA and Pharma Promotional Compliance. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Assume that 10% of Aptar's Asian pharma revenue will shift entirely into European pharma revenue. Retroactively apply this to 2024 financials. Refer to the 2024 ATR report. Return a short message with the values for Asia Pharma and Europe Pharma for their corresponding revenue under this set of assumptions. Round dollar amounts to the nearest thousand.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Run detailsPublic trace |
| GPT-5.5 | dual | 0/2 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States the revenue corresponding to Asia is $209,502,000
States the revenue corresponding to Europe is $829,884,000