APEX-Agents · Management Consulting

World 128_RG_01

3/8Fail

APEX-Agents task World 128_RG_01 in AI Agents for Cross-Border Regulatory Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Cross-Border Regulatory ReviewManagement Consulting World 128Dual harnessGrader: rubric

Task IDtask_a89f67b98b5e468d8d5f2a359db895d6

WorldManagement Consulting World 128

Expected outputmessage_in_console

Published runs5 models · dual config

Task prompt

What the agent was asked to do

Hi, can you calculate the estimated size of all Frontier's business units in 2035? You might need to conduct growth forecasting to assess the overall size of the markets they operate in by 2035. Let's assume the growth rate and market share will remain constant until 2035. Also, calculate the expected profit for each business unit. Round all final answers to two decimal places. Where ranges are provided, use the mid-point of the provided values. Print out the answers here.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	3/8	Fail	Share page Public trace
Gemini 3.1 Pro	dual	3/8	Fail	Share page Public trace
GPT-5.4	dual	3/8	Fail	Share page Public trace
GPT-5.4 mini	dual	1/8	Fail	Share page Public trace
GPT-5.4 nano	dual	3/8	Fail	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States the expected revenue of AmensaDrive in 2035 is $62.77 billion
Fail
Evidence: TEXT_RESPONSE table lists AmensaDrive 'Estimated 2035 BU Size / Revenue' as '$51.87B'. Assessment: Criterion requires stating expected revenue of AmensaDrive in 2035 is $62.77 billion; response states a different value, so fail.
States the expected revenue of SkyLink Atmos in 2035 is $1.06 billion
Fail
Evidence: TEXT_RESPONSE table lists SkyLink Atmos 'Estimated 2035 BU Size / Revenue' as '$1.56B'. Assessment: Criterion requires $1.06 billion; response states a different value, so fail.
States the expected revenue of AmensaMech in 2035 is $1.14 billion
Pass
Evidence: TEXT_RESPONSE table lists AmensaMech 'Estimated 2035 BU Size / Revenue' as '$1.14B'. Assessment: Criterion requires expected revenue of AmensaMech in 2035 is $1.14 billion; response matches, so pass.
States the expected revenue of SolisOne in 2035 is $10.69 billion
Fail
Evidence: TEXT_RESPONSE table lists SolisOne 'Estimated 2035 BU Size / Revenue' as '$17.74B'. Assessment: Criterion requires $10.69 billion; response states a different value, so fail.
States that the 2035 expected profit for AmensaDrive is $2.59 billion
Pass
Evidence: TEXT_RESPONSE table lists AmensaDrive 'Expected Profit' as '$2.59B'. Assessment: Criterion requires 2035 expected profit for AmensaDrive is $2.59 billion; response matches, so pass.
States the 2035 expected profit for SkyLink Atmos is $0.12 billion
Fail
Evidence: TEXT_RESPONSE table lists SkyLink Atmos 'Expected Profit' as '$0.19B'. Assessment: Criterion requires $0.12 billion; response states a different value, so fail.
States that the 2035 expected profit for AmensaMech is $0.26 billion
Pass
Evidence: TEXT_RESPONSE table lists AmensaMech 'Expected Profit' as '$0.26B'. Assessment: Criterion requires 2035 expected profit for AmensaMech is $0.26 billion; response matches, so pass.
States that the 2035 expected profit for SolisOne is $4.24 billion
Fail
Evidence: TEXT_RESPONSE table lists SolisOne 'Expected Profit' as '$7.98B'. Assessment: Criterion requires $4.24 billion; response states a different value, so fail.