APEX-Agents · Law
LawWorld417_AS_03
APEX-Agents task LawWorld417_AS_03 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
As you know, “Bare Bones Decor” - Ava Kim’s limited series - is near completion. We have been collaborating with Ava on this production for months, with the understanding that Streams would retain the exclusive rights to broadcast it and then package it as an online course, with a 50/50 revenue split with Ava. This was all documented in email exchanges and in meetings with Ava’s counsel, but we have yet to draft an exclusivity contract for the work. Now that the ParaZon acquisition is on the horizon, it’s crucial that we distinguish “Bare Bones Decor” from Ava’s other non-exclusive, transferable content (as per her general talent contract). Can you draft an amendment to her talent contract that outlines Bare Bones Decor’s exclusivity arrangement? Draft it in such a way that it is incorporated into the Asset Purchase Agreement with ParaZon. We do not want to transfer our exclusive rights to Bare Bones and would like to do so without getting ParaZon involved. Just print your assessment to me here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.4 nano | dual | 6/7 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 5/7 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 5/7 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 4/7 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 0/7 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/7 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the agreement amends the original talent contract between Ava Kim and Streams
States that the scope of the contract is specifically limited to licensure of the video series "Bare Bones Decor."
States that the agreement grants Streams an exclusive license to Bare Bones Decor
States that the permitted use of the series includes a one-time broadcast on mainstream media
States that the permitted use of the series includes a direct-to-consumer sale as an online course
States that Streams' exclusive license to the series is non-transferable
States that Streams will list its exclusive rights to the series in a carve-out section of excluded assets in any asset purchase agreement