APEX-Agents · Law
World418_BA_01
APEX-Agents task World418_BA_01 in AI Agents for Joint Venture Legal Structuring. Compare dual-harness agent runs across models, scores, and public traces.
Task prompt
What the agent was asked to do
Does any agreement between us and BlueAnchor create any non-disclosure obligations preventing our owner from publicly announcing the deal? Write me a short reply back that I can review and send.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| Gemini 3.1 Pro | dual | 2/10 | Fail | Run detailsPublic trace |
| GPT-5.4 nano | dual | 2/10 | Fail | Run detailsPublic trace |
| GPT-5.5 | dual | 2/10 | Fail | Run detailsPublic trace |
| GPT-5.4 | dual | 1/10 | Fail | Run detailsPublic trace |
| fireworks models Kimi K2 | dual | 0/10 | Fail | Run detailsPublic trace |
| GPT-5.4 mini | dual | 0/10 | Fail | Run detailsPublic trace |
Grading rubric
Rubric criteria
Runs are graded against these criteria. Open a run for model-specific verdicts.
States that the Assignment Agreement includes a confidentiality clause
States that the scope of the Assignment Agreement's confidentiality clause is limited to information concerning the assignment of the Shipbuilding Contract
States that the Shipbuilding Contract includes a confidentiality clause
States that the scope of the Shipbuilding Contract's confidentiality clause is limited to all of the following: (1) technical information and (2) commercial terms of the Shipbuilding Contract
States that LNG Shipping Inc. is no longer bound by the Shipbuilding Contract's confidentiality clause
States that the Ship Management Agreement includes a confidentiality clause
States that the scope of the Ship Management Agreement’s confidentiality clause is limited to information relating to the management of carrier vessels for the BlueLNG JV LLC
States that all of the following agreements do not contain confidentiality obligations: (1) the Joint Venture Agreement and (2) the Operating Agreement
States that LNG Shipping does not have an obligation to keep confidential the existence of the deal to set up BlueLNG JV
States that the owner of LNG Shipping can publicly announce the deal