Raycaster / evalsAll benchmarks

Cross-benchmark category

Hospitality Loyalty Strategy

Compare AI agent runs for Hospitality Loyalty Strategy: prompts, scores, grades, and public traces. This page showcases APEX-Agents tasks that test whether AI agents can analyze hospitality loyalty strategy, rewards redesign, loyalty economics, and engagement modeling.

Travel consulting AILoyalty economics, rewards redesign, engagement modeling
51Tasks
13Primary
1Benchmarks

Published model evidence

A quick view of shareable runs in this category. Open task and trace pages for the prompt, response, files, and grading details.

Gemini 3 Flash55% pass

6/11 runs · avg score 64%

gpt-5.4-mini45% pass

23/51 runs · avg score 73%

gpt-5.4-nano41% pass

21/51 runs · avg score 62%

gpt-5.535% pass

18/51 runs · avg score 59%

GPT-5.433% pass

17/51 runs · avg score 59%

Gemini 3.1 Pro31% pass

16/51 runs · avg score 55%

Primary tasks

13 tasks with this category as their main focus.

  1. Change in Competitor SG&A Spend by Category_Task02_SCAPEX-Agents(task_449e96fd1efb4a7f9ecbb65e82fbd6c1)0/7 · Fail

    Analyze the SG&A files to compare the CAGR trends of competitors versus Impact’s US business across 2020–22 and 2022–24. For each SG&A Category, determine the percentage point change in CAGR between t…

  2. Task Seed 2_Adjust TargetAPEX-Agents(task_75bca3bb30dc4d9db71d253063c96e97)5/5 · Pass

    Can you take a fresh pass at our cost savings targets? Start by resetting the Manufacturing and Supply Chain savings goals based on the best-in-class cost as a percentage of 2024 revenue benchmarks. …

  3. Task unc2be9c - EMAPEX-Agents(task_8f47fc64814943c2a782a2b8704a3ba3)1/2 · Fail

    Was the data Ecan provided during the meeting (noted in the team sync-up from 11/21/25) on the number of members that have stayed during Q3 2025 correct? Use our data from the 11/17 stay and booking d…

  4. World 112-1 | Task 2 - Depreciation Reduction for plants (JS)APEX-Agents(task_6b27cc3ab9da428eaa9daa9f5100882b)6/7 · Fail

    Calculate 2024 manufacturing overhead (MOH) costs in $ for each Impact plant. Use the midpoint value of the benchmark ranges for the specific product type manufactured at the plant from the attached f…

  5. World 133 - NK Task #1APEX-Agents(task_effa0ae896284b07984dd5cc7151e10f)1/4 · Fail

    What are the projected 2026 aggregate free night bookings for Marriott, Hilton, and Hyatt in New York, London, and Tokyo combined? Assume all of Summit's 2026P free night certificate redemptions from…

  6. World 133 EL Task 05APEX-Agents(task_757aca3744044e13a8b323fe623e83ca)5/7 · Fail

    Using 'Accor Presentation.pdf', 'Hilton Annual Report.pdf', 'Hyatt 10K.pdf', 'IHG Investor Presentation.pdf', and 'Marriott-2024-Annual-Report.pdf': 1. Calculate, for each of Summit's key competitors…

  7. World112-1_Task02_NAAPEX-Agents(task_d1185507e9d24d74aaff30450c2698ed)2/2 · Pass

    Calculate the difference in dollars between Impact's actual 2024 US COGS and the hypothetical US COGS if they reached the straight average of COGS as a percentage of revenue given in Exhibit 2 of the …

  8. World112-1_Task05_NAAPEX-Agents(task_b63eb63a9b964203bb7033ed3682f06e)2/3 · Fail

    We need to perform a payback period analysis for the investment to upgrade Lorexa's equipment to adopt continuous manufacturing. The methodology and results of the previous cost-benefit analysis of up…

  9. World112-1_TK_02APEX-Agents(task_112defba78604abcb27f4afb573d8d05)0/1 · Fail

    Can you do some benchmarking analysis of Impact with its 6 peers for 2024 US operations? Let me know the difference between the lowest average monthly revenue per batch passed and the highest average …

  10. World112-1_TK_03APEX-Agents(task_45f1d761bb464e18993968273a9a9040)1/1 · Pass

    Can you please do some what-if analysis of Impact with its 6 peers for 2024 US operations and let me know the following: If the Impact site with the lowest average monthly revenue per head operated a…

  11. World112-1_TK_04APEX-Agents(task_854fefdbea5740a3a238c5930c2721e7)2/2 · Pass

    Can you please calculate the z score of US 2024 Average Monthly Revenue per Head, for all of Impact’s sites? Use a distribution of US 2024 Average Monthly Revenue per Head per site for all the sites i…

  12. world133_ln_03APEX-Agents(task_15322a4e4ca744fb9bf7a9b8cace8a99)2/4 · Fail

    Determine CAGR for total points sold over the entire covered time period from the Profit and Loss Master Profitability Workbook. Apply that growth rate to average points per member from the Member Poi…

  13. World135_KS_Task 3APEX-Agents(task_b039d9d896d546e8a9ab788a5a3a442f)7/7 · Pass

    Use the State of Fashion Beauty report for June 2025 to identify which 3 countries have the most customer engagement in live social media shopping events, measured by the percentage of customers who h…

Related tasks

38 tasks that also exercise this work as part of a broader assignment.

  1. CW134 Aditi 03APEX-Agents(task_21b14fd7ec454ab38e07d2c4055d1fff)2/6 · Fail

    To better understand the market dynamics, the client wants to analyze customer engagement with the mobile app features. Use the feature dataset for competitors from 2016-24 to calculate the following …

  2. Law_World_423_DM_03APEX-Agents(task_39431bef81164cd2843e9369b8f7fdc5)2/3 · Fail

    Northstar is evaluating a situation where Bluequill had utilized the EU personal data received by its analytics module from Northstar, and utilized it for the purposes of sending out marketing emails …

  3. Law_World_423_DM_04APEX-Agents(task_3e4eba49c9cd4d3fa0de912ab1b1501e)7/10 · Fail

    Northstar's CEO sent me an email asking for a summary of the company’s liability under US privacy law if the incident occurred to a US customer based in Colorado. Please take the lead on drafting a hi…

  4. Law_World_423_DM_05APEX-Agents(task_58e8668c0a7c47808ff26e7b1e5105ae)2/9 · Fail

    Northstar's US customer, Zellwerk, reported a system-wide outage that delayed access to shipment-tracking data containing health-related product identifiers and customer account IDs. During the outage…

  5. Marketing Case Studies_Task03_SCAPEX-Agents(task_f525769ab6a748e6855e03c95e4b4bd7)6/8 · Fail

    Using the research found on pharma marketing and articles around competitor shifts in SG&A spend, identify key trends that Impact can apply to SG&A spend that could reduce overall costs. In particular…

  6. Task 3uy1546eAPEX-Agents(task_2c27b6c0f390410aa6f561e1733faf6a)3/6 · Fail

    Determine which years have the highest and lowest average stay lengths for Bronze Tier members. For each of those years, report the average stay length for Bronze Tier members who stayed at a Summit E…

  7. Task a9r09376APEX-Agents(task_0b28f15c5185453aa21a5b90f05f203d)3/9 · Fail

    Calculate the CAGRs for the ABInBev's 2025 sustainability goals, starting with the 2021 results. Some goals imply declining metrics, like water use, while others are looking to increase, such as the u…

  8. Task ncwq9a4bAPEX-Agents(task_2c7f210d3ffd4052a31decef4c4c6668)1/6 · Fail

    Given our current set of CDP questionnaire responses for Horizon's portfolio companies, identify the three largest risks by potential financial impact across all entries. In cases where a minimum and …

  9. Task Seed #13APEX-Agents(task_ada7c5e9d1a149e780af8d519a9171f6)1/1 · Pass

    During the first 48 minutes of the EU production outage, Northstar's engineering team exported one or two bundled sets of EU production event logs containing personal data to the U.S. analytics vendor…

  10. W132_Task01_DAAPEX-Agents(task_1ecba15d0ac14cb6bb0ebb5b372b2a89)7/8 · Fail

    Calculate and report the following metrics: 1. The Overall Vitamins Purchase Intent Score for each buyer segment. 2. The buyer segment with the highest average purchase intent score for Vitamins 3. Th…

  11. World 133 EL Task 02APEX-Agents(task_701665df7879439b9b723ab716e1b630)3/3 · Pass

    Using only 2024 values from IHG's annual report, tell me: 1. Calculate the room-weighted average occupancy rate for IHG across all of its hotel brands, globally. 2. Using regional occupancy rates and …

  12. World 133 EL Task 03APEX-Agents(task_d01a20f9321341b39059a7629a365232)1/1 · Pass

    Estimate the contribution (in $M) that Summit's loyalty program members will make to its 2025E Program EBITDA in $ millions. Assume that Summit's loyalty program members will contribute, as a % of 20…

  13. World 133 GE Task 3APEX-Agents(task_a28da7dd7f41448d8c6ced3a2a62debe)3/3 · Pass

    We need additional analysis for 2025 cost per activated member (CPAM) under 3 scenarios. I want you to edit the PnL workstream draft deck with this new information you'll calculate--> the 2025 CPAM ($…

  14. World112-1_Task02_TBAPEX-Agents(task_87dd4d824ff84835b0ed505d2499c15a)0/3 · Fail

    I want to inform client discussions around what action to take regarding sourcing of materials and the speculated tariffs. Can you summarize averages of the following 3 data points pertaining to tarif…

  15. World112-1_Task03_NAAPEX-Agents(task_0c527e11cc1c436696561a15eead68b2)10/10 · Pass

    Analyze the attached report and the continuous manufacturing report to state the FDA-encouraged manufacturing style that differs from traditional methods which is mentioned in both reports. Using the …

  16. World112-1_Task04_TBAPEX-Agents(task_d7893ddf035a4abca2990717ad4d7428)4/4 · Pass

    Given the US imposed tariffs on the import of pharmaceutical materials from Germany, India, China at the rates 10%, 15%, 20% respectively, determine the impact of tariffs as a percent increase in pred…

  17. World112-1_Task05_SCAPEX-Agents(task_7c7edc1b3dea41ec89f00eb4581df3fa)3/3 · Pass

    Review industry reports to determine the range of industry-wide reductions in force (RIFs). Using Impact’s revised SG&A breakdown, calculate the cost savings Impact would achieve by reducing its sales…

  18. World125_Task01_NAAPEX-Agents(task_dbf1b00ea3cc4a59af744f370f7a1acf)4/4 · Pass

    Using the 2024 annual report, identify whether Impact Therapeutics sells primarily branded drugs. A company sells primarily branded drugs if the majority of drugs have launch dates within the last 7 y…

  19. World125_Task01_TBAPEX-Agents(task_2a441de423284de492c369432970eef5)3/3 · Pass

    Using the latest materials cost reduction analysis, assume Impact reduces its 2025 materials cost with current supplier relationships by 20%. Benchmark Impact's resulting 2025 materials cost as a perc…

  20. World126_EFA_01APEX-Agents(task_d06ed610563a4dcebc39edbb17b1b757)9/10 · Fail

    Based on Planet Defense's climate risk data and their scoring methodology, give me the top 3 sub-regions by overall risk score and their overall risk scores. Once you've done that, calculate for each …

  21. World126_EFA_04APEX-Agents(task_d91bfafb62c647e9a341d5a14864041b)1/1 · Pass

    How much cash in EUR will adopting Rakling's strong sell recommendations generate for HP? Assume they sell the position as of October 30, 2025 at no cost. Report your final answer here in dollars and…

  22. World126_EFA_05APEX-Agents(task_7cec4caf8ace406da19eeb72688f43f6)0/2 · Fail

    Can you calculate the minimum gross returns Crown and Vision would have to achieve in order to deliver net returns equal to the average fund manager in the 80th percentile or better in terms of Sharpe…

  23. World126_JD_04APEX-Agents(task_c5080c2d60fa457faeb309841b8b442a)0/4 · Fail

    Please check how KO and MDLZ differ in expected upside once we apply the ESG and GLP-1 filters and account for each investor’s maximum allowable ESG risk level. Use the survey data and the ESG risk th…

  24. World126_TK_01APEX-Agents(task_9d421716ffeb40b79e9e132054714afe)3/3 · Pass

    I feel good about our current assessment of the valuation, but I’d like to do some forward-looking assessments. Can you use the historical Sector Median PE volatility data to determine which of the cu…

  25. World126_TK_04APEX-Agents(task_01bf3f1cdf6c432f822f91666047e38c)0/2 · Fail

    The client is looking to execute our rebalancing recommendations. Identify the stock with the highest Absolute Beta Reliability during the worst 10 trading days in Q3 2025, defined as the worst 10-da…

  26. World132_DA_Task03APEX-Agents(task_63dbfbfa09ea47ea839c99343129196a)0/6 · Fail

    Re-evaluate market entry priorities using the revised weightings for Buyer Profile Score. Identify the Top 3 Markets with the highest Revised Buyer Profile Score under the revised weighting methodolo…

  27. World132_DA_Task06APEX-Agents(task_dba8f191077f4c8a9348139b11c44ce6)0/4 · Fail

    Analyse category consumption patterns and market penetration using the Category Penetration Score methodology for PureLife’s portfolio strategy. Present the cumulative penetration score for each cate…

  28. World133_ln_04APEX-Agents(task_40c59502fc744e85a83bf87dfe8977da)0/3 · Fail

    Give me the scores for Summit’s segments, using the Summit-Specific Survey. Your scoring system must follow these rules: - For the average satisfaction with status benefits from the file “14. Summit…

  29. World133_ln_05APEX-Agents(task_b95db15ad91d4883b23e79d1c1573eb1)6/7 · Fail

    Prepare a new memo, and put it a new document file you make. I will be sending it to James Brown, CEO of Summit, on behalf of The Strategy Team. It should outline the total cost of labor for each pha…

  30. World133_RG_01APEX-Agents(task_8d7835ee0dce4b92b89ebe15540be78c)3/3 · Pass

    Can you use the Summit's business case and provide the revised sum of net cash flow ($m) for scenarios 1, 2, and 3? Apply the scenario-specific benefits multipliers provided in the attached file to ad…

  31. World423_AW_01APEX-Agents(task_56c618b6f1884f168f3e508af61b2d3d)2/3 · Fail

    Our client needs to know if any of that data that was transmitted in the breach is considered personal data under GDPR. Review the four attached incident reports and provide your reply to me with ex…

  32. World423_DPM_01APEX-Agents(task_73363f7afa084f98aeb61ff19ecfabad)0/2 · Fail

    Evaluate whether the breach notification requirements to EU/EEA customers in Version 1 of the Breach and Incident Response Policy are compliant with the GDPR, by answering the following questions: 1) …

  33. World423_DPM_02APEX-Agents(task_327f2507ef39488d9dfc3fbf05ef4c2f)0/4 · Fail

    Review the Controller-to-Supervisory Authority Notification Template, along with the timing set out in the V.2 Breach & Incident Response Policy, to ensure compliance with the notification requirement…

  34. World423_JS_01APEX-Agents(task_afcdcb040d924d4289b2a739e6ac4c49)3/5 · Fail

    Let's assess the applicability of the statement of "[t[hese data elements constitute personal data for GDPR purposes because they relate to identifiable users, even though no directly identifying attr…

  35. World423_JS_02APEX-Agents(task_7e51ed8994924d8d9f92938fd8cf9fd2)5/9 · Fail

    It has come to our attention that some of the data transferred by the "Diagnostics Analytics Module" related to residents of Colorado. Does Colorado Law require us to notify Colorado residents of this…

  36. World423_JS_03APEX-Agents(task_28f0924227374bcea8d59b13e605be90)2/2 · Pass

    Northstar is reviewing its policies for notifying American data subjects in case there is another unauthorized data transfer. Specifically, a lot of Northstar's data subjects reside in the State of Ne…

  37. World423_JS_07APEX-Agents(task_c9fa280149be4bbb99fc9f9065b443cf)1/2 · Fail

    Will Northstar be required to compensate affected data subjects under the General Data Protection Regulation ("GDPR") for the Data Analytics Module's (the "Module") unauthorized data transfer if the d…

  38. World423_JS_08APEX-Agents(task_25e49967231547cab553ed451d6fa338)0/2 · Fail

    Determine if Northstar can be fined under Article 83 of the General Data Protection Regulation ("GDPR") for a violation of Article 14(2)(e) of the GDPR for the data transfer from the Data Analytics Mo…