Cluster-Level Experiments using Temporal Switchback Designs: Precision Gains in Pricing A/B Tests at LATAM Airlines

Experimentation is central to modern digital businesses, but many operational decisions cannot be randomized at the user level. In such cases, cluster-level experiments, where clusters are usually geographic, come to the rescue. However, such experiments often suffer from low power due to persistent cluster heterogeneity, strong seasonality, and autocorrelated outcome metrics, as well as common shocks that move many clusters simultaneously. On an example of airline pricing - where policies are typically applied at the route level and thus the A/B test unit of analysis is a route - we study switchback designs to remedy these problems. In switchback designs, each cluster (route in our case) alternates between treatment and control on a fixed schedule, creating within-route contrasts that mitigate time-invariant heterogeneity and reduce sensitivity to low-frequency noise. We provide a unified Two-Way Fixed Effects interpretation of switchback experiments that makes the identifying variation explicit after partialling out route and time effects, clarifying how switching cadence interacts with temporal dependence to determine precision. Empirically, we evaluate weekly and daily switchback cadences using calibrated synthetic regimes and operational airline data from ancillary pricing. In our evaluations, switchbacks decrease standard errors by up to 67%, with daily switching yielding the largest gains over short horizons and weekly switching offering a strong and simpler-to-operationalize alternative.

• Publication year

  2026

• Venue

  Unknown venue

• Publication date

  2026-03-04

• Fields of study

  Mathematics, Business, Economics, Computer Science

• Identifiers
  arXiv 2603.04252
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Two-way fixed effects, the two-way mundlak regression, and difference-in-differences estimators

  2025cited by this paper
• Data-Driven Switchback Experiments: Theoretical Tradeoffs and Empirical Bayes Designs

  2024cited by this paper
• Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experiments

  2024cited by this paper
• Bias-Variance Tradeoffs for Designing Simultaneous Temporal Experiments

  2023cited by this paper
• Design and Analysis of Switchback Experiments

  2020cited by this paper
• Robust causal inference for incremental return on ad spend with randomized paired geo experiments

  2019cited by this paper
• Estimating Ad Effectiveness using Geo Experiments in a Time-Based Regression Framework

  2017cited by this paper
• A Practitioner’s Guide to Cluster-Robust Inference

  2015cited by this paper
• Designing and deploying online field experiments

  2014cited by this paper
• A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix

  2014cited by this paper
• Estimating Average Causal Effects Under General Interference

  2012cited by this paper
• Measuring Ad Effectiveness Using Geo Experiments

  2011cited by this paper
• Computing Robust Standard Errors for Within-Groups Estimators

  2009cited by this paper
• Mostly Harmless Econometrics: An Empiricist's Companion

  2008cited by this paper
• Toward Causal Inference With Interference

  2008cited by this paper
• Multiple Time Series

  2005cited by this paper
• Time series analysis.

  2003cited by this paper
• Econometric Analysis of Cross Section and Panel Data

  2002cited by this paper
• Forecasting Using Principal Components From a Large Number of Predictors

  2002cited by this paper
• Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation

  1991cited by this paper
• Taylor's Power Law for Dependence of Variance on Mean in Animal Populations

  1981cited by this paper
• Intervention Analysis with Applications to Economic and Environmental Problems

  1975cited by this paper
• Time series analysis, forecasting and control

  1972cited by this paper
• Aggregation, Variance and the Mean

  1961cited by this paper

• No citing papers are available for this paper.