Raycaster/ Eval

APEX-Agents

Gemini 3.1 Pro on Task 4

0/3Fail
Domain
Management Consulting
Category
AI Agents for M&A Legal Due Diligence
Harness
dual

Grader rubric

Criteria verdict

  1. States that the total policy-friction risk for North America is $3.146M

  2. States that the total policy-friction risk for the UK is $3.063M

  3. States that the total policy-friction risk for Europe is $3.011M

Prompt excerpt

Task context

For 2024 Won/Upsold deals with NCV ≥ 50k, determine the policy-friction risk per deal as NCV × Discount × tier multiplier × tier PFI, where tier PFI is the benchmark mix-weighted sum of Software Customer User Satisfaction Survey Results. After you rank the regions by the total policy-friction risk, please give me the top 3 regions and their respective total policy friction risk (in $M, rounded to three decimal places) in any order. Refer to the following three files: 1) Deal Transactions sheet, 2) the Customer User Satisfaction Survey Results chart in the software pricing trends doc, and 3) the attached policy mix and multiplier charts. Give me your answers as a reply right here.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.