Raycaster/ Eval

Company environment · IVD & medical devices · FDA CDRH

A cancer genetic-testing lab

The approval application is being finalized for filing. Start at the top to see what the company does, then the jobs AI models were given here and how each scored.

1What does this company do?

A lab company that reads the genes of tumor samples to guide cancer treatment.

Doctors send in tumor tissue; the lab sequences it and reports which gene changes it finds. This is a medical device, reviewed by the FDA’s device center.

2Where is the product on its way to patients?

Its tumor gene test is about to be filed with the FDA for approval.

  1. 1Discovery
  2. 2Lab & animal studies
  3. 3Human trials
  4. 4Filing & review
    • The product is here
  5. 5Approved
  6. 6On the market

The test also works as a “companion diagnostic”: it tells doctors whether a patient qualifies for particular cancer drugs. Every claim about which drugs it can match must be backed by evidence.

3What is happening right now?

The application goes out on the 6th, and several sections are still unfinished.

Each team owns a section: what the test is for, its labeling, lab performance, clinical evidence, software, and which samples are accepted. Each must agree with the others and with the evidence.

4Which jobs were the models given?

6 jobs, each graded against a specialist’s checklist.

Scores are checks passed out of checks in the list. Each model ran each job once.

JobSolOpusAstra
01Decide what the test may officially claim to be used for, and which drug pairings the evidence supports.2/85/85/8
02Finish the test’s labeling so it matches the drug labels and the evidence on file.2/128/128/12
03Write up the lab performance testing that was actually done, including its limits.4/87/88/8
04Write the clinical-evidence position: what each study really shows about the test.4/104/105/10
05Evaluate the analysis software: what it does, how it is controlled, and what it depends on.13/1814/1812/18
06Set the rules for which tumor samples the lab accepts and rejects.9/1612/1612/16

5–7Evidence, work and verdict

This company’s files stay private.

It is built from a real product’s records, so its files, runs and checklists aren’t published. To follow a job all the way down to each check, open one of the public environments.

Havenor Therapeutics (fictional, fully published) →
Broad Institute (real, public FDA record) →

← Back to all company environments