Raycaster/ Eval

APEX-Agents · Law

World_421_ANB_02

Best published4/5Fail

APEX-Agents task World_421_ANB_02 in AI Agents for Healthcare and Senior Living Legal Risk. Compare dual-harness agent runs across models, scores, and public traces.

AI Agents for Healthcare and Senior Living Legal RiskLaw World 421Dual harnessGrader: rubric
task_ed8356c4f4c146b58d2cd869924fdfe3
Law World 421
message_in_console
7 models · dual config

Task prompt

What the agent was asked to do

Our client, Senior Living Lending, Inc. ("SLL") is a reverse mortgage and home equity line of credit lender. They want to implement a telemarketing program that relies heavily upon texting potential borrowers. SLL has heard that financial institutions are exempt from the Telemarketing Sales Rule ("TSR"). Reply in here, explaining whether they are exempt from the TSR.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
Gemini 3 Flashdual4/5Fail
fireworks models Kimi K2dual3/5Fail
Gemini 3.1 Produal3/5Fail
GPT-5.4 nanodual3/5Fail
GPT-5.4dual1/5Fail
GPT-5.4 minidual1/5Fail
GPT-5.5dual1/5Fail

Grading rubric

Rubric criteria

Runs are graded against these criteria. Open a run for model-specific verdicts.

  1. States that Senior Living Lending, Inc. is not exempt from the Telemarketing Sales Rule.

  2. States that Senior Living Lending, Inc.'s products include non-traditional home equity lines of credit.

  3. States that the Telemarketing Sales Rule is subject to the jurisdiction of the Federal Trade Commission Act.

  4. States that Senior Living Lending, Inc. is not an exempt entity under the Federal Trade Commission Act.

  5. States that the Federal Trade Commission has already enforced the Telemarketing Sales Rule against several mortgage lending companies.