APEX-Agents · Law
World418_EK_01
APEX-Agents task World418_EK_01 in AI Agents for Joint Venture Legal Structuring. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Does assigning the shipbuilding contract to the JV require any other member consents (under the JV Operating Agreement) that we don't already have? Write out your answer to me here, and give a short reason to justify it.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| fireworks models Kimi K2 | dual | 5/5 | Pass | Run detailsPublic trace |
| GPT-5.4 nano | dual | 5/5 | Pass | Run detailsPublic trace |
| Gemini 3 Flash | dual | 4/5 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 4/5 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 4/5 | Fail | Run detailsPublic trace |
| Gemini 3.1 Pro | dual | 3/5 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 3/5 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States No, assigning the shipbuilding contract to the JV does not require any other member consents under the JV Operating Agreement
States that the assignment of the shipbuilding contract is LNG Shipping's initial capital contribution to the joint venture
States that accepting initial capital contributions is not a reserved matter under the Joint Venture Operating Agreement
States that accepting initial capital contributions does not require any further member consent under the JV Operating Agreement
States that the Joint Venture Operating Agreement does not impose additional member consent requirements for accepting the the assignment of the shipbuilding contract