Raycaster/ Eval

Company worlds

Step inside the desks our agents work.

Step inside the company desks our benchmarks are built on — the documents, assignments, and scored agent work, published in full.

  1. Broad Institute — Divalent siRNA IND ResponseBuilt from a real public FDA recordA real partial clinical hold, rebuilt verbatim from the Broad Institute’s public IND filing — 294 real files. Frontier models did the work; the best still authorized activity FDA had frozen.
  2. Havenor TherapeuticsA fictional company we can publish in fullA simulated pharmaceutical desk — 853 files, working systems, and 120 colleagues on chat who answer in character. Models sail through the routine and fail the judgment calls.