8/13 runs · avg score 78%
Cross-benchmark category
Energy Grid Resilience
Compare AI agent runs for Energy Grid Resilience: prompts, scores, grades, and public traces. This page showcases APEX-Agents tasks that test whether AI agents can reason about energy grid resilience, curtailment, redispatch, VOLL, and transmission asset risk.
Published model evidence
A quick view of shareable runs in this category. Open task and trace pages for the prompt, response, files, and grading details.
13/33 runs · avg score 58%
12/33 runs · avg score 62%
12/33 runs · avg score 57%
5/15 runs · avg score 57%
11/33 runs · avg score 55%
Related tasks
33 tasks that also exercise this work as part of a broader assignment.
Northstar's US customer, Zellwerk, reported a system-wide outage that delayed access to shipment-tracking data containing health-related product identifiers and customer account IDs. During the outage…
We've received the attached warranty claims for some of our products. Please review them. Then, edit the existing existing "product purchases" spreadsheet to show the maximum refund amount a customer …
Can you review Sections 8.4, 9.1, 9.3,10.1,14.7 in our MSA, against the below outage scenario? A faulty update causes endpoint failures. The customer sends a breach notice by email to a support inbox…
CrowdStrike's general counsel sent us a complaint filed in U.S. district court by Larry Stone, alleging violations under Sections 10(b) and 20(a) of the Securities Exchange Act of 1934, as well as Rul…
Analyze whether Counts 1-7 of Delta's Complaint against CrowdStrike fall within the limitation of liability clause in Section 10.1 of CrowdStrike's standard MSA, indicating "Covered" or "Not Covered" …
A real-time Rapid Response Content (RRC) update is automatically delivered and it causes performance degradation in a customer’s environment. The customer did not stage deployments, had no rollback pl…
During the first 48 minutes of the EU production outage, Northstar's engineering team exported one or two bundled sets of EU production event logs containing personal data to the U.S. analytics vendor…
CrowdStrike sent the attached list of historic stock transactions (note the document lists transactions for both Class A and B stocks). We need to determine if any of these people would be a part of…
Update numbers with the new projections (attached). I want the full breakdown for: DC converters and onboard chargers Driveline and axle modules Engine control units Engine core hardware Exhaust and …
Assuming Eurogrid goes through with the labor reallocation efforts described in the operational efficiency analysis, calculate both the % of total staff that is a manager and the average span of contr…
Identify the region with the highest average asset-level Total Score (defined as the sum of Criticality Score, Renewable Impact, and Risk Score), and the country within that region that has the highes…
Please use EuroGrid's headcount per department and the attached benchmarks to calculate the estimated total cost of each of the departments' headcount. Round all final amounts to full USD. Provide yo…
Please calculate how much Germany's and Netherlands' renewables pipelines (will be only 95%) will cover out of their total yearly loads in 2027 and 2028 in % terms. You can use their average historica…
Review the following: the statement dated July 19, 2024 from George Kurtz, the Form 8-K from Crowdstrike dated July 19, 2024 and Rule 10b-5. Based solely on these documents, identify any statements ma…
Can you please evaluate the outage causes that affect each country the most, in terms of total outage duration? Categorize hazards relating to flooding or storms as the "Weather - Storm" cause and tho…
Senior Living Lending, Inc. ("SLL") emailed me because they are concerned that responses to their ad campaigns may fall under the Telemarketing Sales Rule (“TSR”). Can you please draft the content for…
EuroGrid wants to understand whether the root cause of its asset failures can be explained by age, load, and/or frequency of weather events. Identify the 3 manufacturers with the highest total failur…
Take a look at our workforce distribution in the country where we've spent the most on OPEX from 2020-24. Knowing we need 2 line technicians per transmission line, 1 substation technician for each sub…
Identify the Phase 1 Assets from the 10 Year Roadmap, assuming that SAIFI / SAIDI hotspots can be defined as assets having SAIFI > 1.0 and SAIDI > 60. Ignore the key criteria for substations and the n…
Looking only at projects in the Connection Queue that have a status of "Approved" or "Connected", calculate the percentage of the Total Forecasted Demand for the years 2026, 2027, and 2028 that could …
Can you calculate the annual EU implied revenue for each Eastern European TSO? Use the midpoint of their implied market share ranges and 40 billion euros as the total market size. Using the implied r…
Calculate the NPV from the 12-year cash flow on renewable enablement benefits, considering the following assumptions: - The steady-state annual benefits from renewable enablement mentioned in the busi…
Can you state the total simple average of the average implementation cost values, across the various technologies? Use the attached implementation cost deck. Also, state how many technologies have a t…
What is the net aggregate annual benefit (i.e., total annual savings minus total annual opex) of all of the use cases in the digital use case sizing analysis? According to the new transmission technol…
Find out the ratio between Curtailment_GWh and Redispatch_GWh and for the lowest average ratio of Country-Region pair, report the average Avoided Curtailment (MWh) and causes of curtailment. Represen…
Using the Digital Twin Input and Additional bus datasets, identify the Bus IDs associated with renewable energy generation. For each of these Bus IDs, calculate the average (in GW) of their three high…
Tell me whether or not the asset type that has the highest average adjusted failure probability per outage is also responsible for the highest average Value of Lost Load (VOLL) per asset. VOLL is defi…
Investigate whether EuroGrid should consider increasing staffing. Determine if the number of working people per impacted asset is correlated with the expected economic impact of unforeseen downtime in…
We want to get ahead of preparing a settlement agreement for the Delta matter. Can you let me know which of Delta’s original causes of actions are no longer live as we head into the pre-trial conferen…
MLT is a CrowdStrike customer severely affected by the outage. MLT filed a lawsuit for negligence seeking to recover damages arising from the outage. Additionally, MLT successfully transferred venue t…
An independent investigation of Crowdstrike's Channel File 291 outage revealed that the devices affected were mostly Microsoft or Google devices, and no Apple devices were affected at all. Is another …
Review only the following: CrowdStrike Form 8-K 2024.pdf Form 8-K Standard.pdf DELTA AIR LINES, INC. 8-K.pdf Today, August 9, 2024, we discovered that the Falcon sensor outage may have been caused by…
It has come to our attention that some of the data transferred by the "Diagnostics Analytics Module" related to residents of Colorado. Does Colorado Law require us to notify Colorado residents of this…