APEX-Agents · Law
World_421_ANB_02
APEX-Agents task World_421_ANB_02 in AI Agents for Healthcare and Senior Living Legal Risk. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Our client, Senior Living Lending, Inc. ("SLL") is a reverse mortgage and home equity line of credit lender. They want to implement a telemarketing program that relies heavily upon texting potential borrowers. SLL has heard that financial institutions are exempt from the Telemarketing Sales Rule ("TSR"). Reply in here, explaining whether they are exempt from the TSR.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/5 | Fail | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 3/5 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 4/5 | Fail | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/5 | Fail | Share pagePublic trace |
| GPT-5.4 | dual | 1/5 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/5 | Fail | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/5 | Fail | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that Senior Living Lending, Inc. is not exempt from the Telemarketing Sales Rule.
PassEvidence: Response says, “SLL should not assume it is exempt from the TSR” and “Unless SLL can confirm that it is itself a bank... SLL should treat the proposed... program as subject to the TSR.” Assessment: Criterion asks whether it states SLL is not exempt from the TSR. Pass; the response clearly states SLL is not generally exempt and likely covered unless it has a qualifying bank/credit-union/savings-association status.
States that Senior Living Lending, Inc.'s products include non-traditional home equity lines of credit.
FailEvidence: Response refers to “reverse mortgage/HELOC telemarketing program” and “home-equity lender,” but does not mention “non-traditional home equity lines of credit.” Assessment: Criterion specifically asks whether it states SLL’s products include non-traditional HELOCs. Fail; the response only says HELOCs, not non-traditional HELOCs.
States that the Telemarketing Sales Rule is subject to the jurisdiction of the Federal Trade Commission Act.
FailEvidence: Response says “some entities are outside the FTC’s jurisdiction and therefore not covered by the TSR” and discusses “FTC’s TSR jurisdiction,” but does not state that TSR is subject to the jurisdiction of the Federal Trade Commission Act. Assessment: Criterion requires stating the TSR is subject to FTCA jurisdiction. Fail; FTC jurisdiction is mentioned generally, but not the FTCA connection.
States that Senior Living Lending, Inc. is not an exempt entity under the Federal Trade Commission Act.
FailEvidence: Response says “If SLL is a non-bank lender: SLL is likely covered” and qualifying exempt entities are “banks, federal credit unions, or federal savings association[s].” It does not state SLL is not exempt under the Federal Trade Commission Act. Assessment: Criterion requires stating SLL is not an exempt entity under the FTCA. Fail; response gives a conditional TSR exemption analysis but does not address FTCA exempt-entity status as such.
States that the Federal Trade Commission has already enforced the Telemarketing Sales Rule against several mortgage lending companies.
FailEvidence: Response discusses TSR provisions covering credit products and advance-fee loans, but contains no statement about FTC enforcement actions against mortgage lending companies. Assessment: Criterion asks whether it states FTC has already enforced the TSR against several mortgage lending companies. Fail; this point is absent.