Raycaster/ Eval

APEX-Agents

gpt-5.5 on World431Task_EL_01

4/6Fail
Domain
Law
Category
AI Agents for Real Estate Lease Review
Harness
dual

Grader rubric

Criteria verdict

  1. States that the Lessee is a signatory to the revised estoppel certificate

    Pass
  2. States that the Lessee certifies and warrants the facts listed in the revised estoppel certificate

    Fail
  3. States that there are no options to terminate the lease early in the revised estoppel certificate

    Pass
  4. States that the "Additional Rent" is the Lessee's proportionate share of operating expenses in the revised estoppel certificate

    Pass
  5. Replaces each instance of "Tenant" with "Lessee" in the revised estoppel certificate

    Fail
  6. Replaces each instance of "Landlord" with "Lessor" in the revised estoppel certificate

    Pass

Prompt excerpt

Task context

After execution, the lender's lawyers identified issues with the final estoppel certificate. Draft a new estoppel certificate that fixes the issues with the current "final" one. Create a new document and put your analysis in there.

Response trace

Agent response, tools, files, and edits

Open full trace

On a phone, the interactive viewer works best full-screen — pick the narrative report or the files & trajectory workspace.

Why Eval exists · why Workspace exists

Public evidence and cloud agents are the same harness.

Eval exists so scores are inspectable—tasks, trajectories, artifacts, and rubric verdicts anyone can open.Workspace exists so people can automate real file work with that harness, and so Raycaster never evaluates work it cannot perform.