Evaluating dynamic conditional quantile treatment effects with applications in ridesharing

Li, Ting, Shi, Chengchun ORCID: 0000-0001-7773-2099, Lu, Zhaohua, Li, Yi and Zhu, Hongtu (2024) Evaluating dynamic conditional quantile treatment effects with applications in ridesharing. Journal of the American Statistical Association, 119 (547). 1736 - 1750. ISSN 0162-1459

Text (Evaluating dynamic conditional quantile treatment effects with applications in ridesharing) - Accepted Version Available under License Creative Commons Attribution. Download (3MB)

• Author
• Scopus publication

Abstract

Many modern tech companies, such as Google, Uber, and Didi, use online experiments (also known as A/B testing) to evaluate new policies against existing ones. While most studies concentrate on average treatment effects, situations with skewed and heavy-tailed outcome distributions may benefit from alternative criteria, such as quantiles. However, assessing dynamic quantile treatment effects (QTE) remains a challenge, particularly when dealing with data from ride-sourcing platforms that involve sequential decision-making across time and space. In this article, we establish a formal framework to calculate QTE conditional on characteristics independent of the treatment. Under specific model assumptions, we demonstrate that the dynamic conditional QTE (CQTE) equals the sum of individual CQTEs across time, even though the conditional quantile of cumulative rewards may not necessarily equate to the sum of conditional quantiles of individual rewards. This crucial insight significantly streamlines the estimation and inference processes for our target causal estimand. We then introduce two varying coefficient decision process (VCDP) models and devise an innovative method to test the dynamic CQTE. Moreover, we expand our approach to accommodate data from spatiotemporal dependent experiments and examine both conditional quantile direct and indirect effects. To showcase the practical utility of our method, we apply it to three real-world datasets from a ride-sourcing platform. Theoretical findings and comprehensive simulation studies further substantiate our proposal. Supplementary materials for this article are available online Code implementing the proposed method is also available at: https://github.com/BIG-S2/CQSTVCM.

Item Type:	Article
Official URL:	https://www.tandfonline.com/journals/uasa20
Additional Information:	© 2024 American Statistical Association
Divisions:	Statistics
Subjects:	H Social Sciences > HA Statistics Q Science > QA Mathematics
Date Deposited:	25 Mar 2024 11:48
Last Modified:	20 Dec 2024 00:53
URI:	http://eprints.lse.ac.uk/id/eprint/122488

Actions (login required)

View Item