Raycaster/ Eval

Company environment · Targeted small molecules · clinical operations

A hospital running a cancer drug trial

In its pivotal human trial; the site is starting up. Start at the top to see what the company does, then the jobs AI models were given here and how each scored.

1What does this company do?

A large cancer hospital that runs clinical trials for drug companies.

The hospital is a trial “site”: it enrolls patients, gets ethics (IRB) approval, keeps the official study files and bills correctly. The drug company sponsors the study; the hospital does the work on the ground — and keeps custody of the records it produces.

For experts

Academic cancer-center investigator site; site-custody ISF and CTMS records sit apart from sponsor-owned protocol and safety records, with review under a central-IRB reliance agreement.

2Where is the product on its way to patients?

A drug company’s pill for advanced breast cancer, in its main (pivotal) trial.

  1. 1Discovery
  2. 2Lab & animal studies
  3. 3Human trials
    • The product is here
  4. 4Filing & review
  5. 5Approved
  6. 6On the market

The hospital is preparing to open the trial locally — nothing enrolls until the local file matches the current study plan exactly. Later, a separate job audits the site mid-trial after the plan was amended: who needed new consent, and whether dosing ran under it.

For experts

Oral targeted therapy in a pivotal advanced-breast-cancer trial; jobs come from the site’s own work queue, from consent readiness through a mid-study amendment audit.

3What is happening right now?

The ethics submission deadline and the sponsor’s site initiation visit are both close.

Before any patient enrolls, the consent form, ethics submission, investigator paperwork, coverage analysis and study files all have to match the current study plan.

4Which jobs were the models given?

10 jobs, each graded against a specialist’s checklist.

Scores are checks passed out of checks in the list. Each model ran each job once.

JobSolOpusAstra
01Get the site’s consent form ready for investigator review — current protocol, site-specific language, open decisions flagged.8/1311/1310/13
02Reconcile the site regulatory file and screening log against the records the site controls.8/109/107/10
03Prepare the initial IRB submission package for investigator sign-off — transmittal, current protocol and consent, review route.1/63/65/6
04Run final QC on the start-up package as one package — consent, submission, ISF records, participant tracking, delegation.7/125/127/12
05Complete the investigator review and release the Form FDA 1572 signature package.6/149/1413/14
06Reconcile the returned central-IRB reliance and transfer records and stage the investigator decision.8/159/1514/15
07Decide whether the site’s actual commitments can support the proposed site initiation visit, and return the site’s written answer to the sponsor.1/1511/1511/15
08Lock the coverage-analysis and sponsor-negotiation positions, then release the matching CTMS visit build.7/159/159/15
09Reconstruct the referral-control incident, decide what the review may authorize, and leave owners and controls to prevent a repeat.13/1513/1514/15
10Audit the site’s records after the latest protocol amendment — who needed re-consent, whether dosing ran under the right consent.9/127/128/12

This company’s files stay private.

The jobs on this page are scored as part of the official 71-task benchmark. The files, the model’s steps, and each check stay unpublished, because they come from a real product’s records. To follow a job all the way down, open one of our open companion showcases (evaluated separately from the benchmark totals).

Havenor Therapeutics (fictional showcase) →
Broad Institute (public FDA record showcase) →

← Back to all company environments