APEX-Agents · Law
LawWorld417_NE_03
APEX-Agents task LawWorld417_NE_03 in AI Agents for Employment Law Analysis. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
We're helping one of ChasingStreams's talent partners create a project for distribution on their channel(s). In addition to providing the production stages, ChasingStreams will contribute $10,000 cash plus $20,000 in employee time. We're otherwise staying hands-off with the project. Do we need any separate agreements with the talent? Give m the answer straight here and explain why, briefly.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 6/6 | Pass | Run detailsPublic trace |
| GPT-5.4 | dual | 5/6 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 3/6 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/6 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 1/6 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/6 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States Yes, a separate revenue agreement between ChasingStreams and each of the talent is required for the project
States that the IP & Content Ownership Policy requires a separate revenue agreement for a Co-Created Work
States that the project is a Co-Created Work under the IP & Content Ownership Policy
States that ChasingStreams contributed $30,000 in production costs to the Talent's project
States that ChasingStreams must contribute at least $25,000 to the cost of a production for it to constitute a Co-Created Work
States that ChasingStream's financial contribution to the project's production cost exceeds the threshold amount required for a project to constitute a Co-Created Work under the IP & Content Ownership Policy