Raycaster / evalsBack to SpreadsheetBench

SpreadsheetBench

9569

0/1Fail

SpreadsheetBench task 9569. Inspect the exact spreadsheet prompt, compare published model runs, open the agent response trace, and review grades for workbook editing.

Spreadsheet editingDual harness
ssb-9569
SpreadsheetBench
2 models
Dual (parsed + original)
PromptWorkbook objective and answer cells
ResponseOpen each trace to inspect tool use and edits
GradeCompare score and pass/fail by model

Task prompt

What the agent was asked to do

You are solving a spreadsheet benchmark task in a real workbook. Objective: Produce the correct final workbook state for the expected answer region. What matters: - Only the values in the expected answer region will be graded. - The workbook is the answer. Instructions: 1. Read the workbook and inspect the relevant data region first. 2. Infer the required result for the provided workbook instance. 3. Write the final value(s) directly into the expected answer region. 4. Do not rely on prose, formulas in your chat response, pseudocode, or VBA as the answer unless the benchmark explicitly requires those to be written into cells. 5. If the natural-language task asks for a general method, formula, or macro, convert that into the concrete result needed for this workbook instance. 6. Keep your final text response short and only summarize the workbook cells you changed. Relevant data region(s): Expected answer region(s): AO9:AO1288 Expected answer sheet(s): Task: I need a formula to identify the earliest non-zero value entered for each row, specifically within column 'AO,' from a range of months (e.g., from Jan 2015 onward). The workbook I'm working on will be updated monthly with new data, and the values are percentages such as 17.07% for contract #10007 in Mar-2015. It is important that the formula avoids using array formulas to prevent the workbook from freezing due to a potentially long list of data. I am struggling to find a formula that I could use in order to find the EARLIEST value entered from several months. Attached is a workbook that will be populated each month and will potentially have values from Jan 2015 through whatever the latest month would be........for each row, I need to pick the earliest value entered on column "AO". As an example on 1st row, the earliest value for contract # 10007 is 17.07% entered in Mar-2015, contract 10008 would 18.20% entered in Jun 2015, etc..Since this list will be long, it would be preferable to have a formula that does not use array formulas as I find that this type of formula typically freezes the workbook. Need to enter a formula that captures the earliest value entered from any given time period without manually entering value in each row.

Published trajectories

Agent runs on this task

Curated dual-harness runs. Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.4showcasedual0/1Fail
Gemini 3.1 Produal1/1Pass