Blessing from human-AI interaction: super policy learning in confounded environments

Wang, Jiayi, Qi, Zhengling and Shi, Chengchun ORCID: 0000-0001-7773-2099 (2025) Blessing from human-AI interaction: super policy learning in confounded environments. Journal of the American Statistical Association. ISSN 0162-1459 (In Press)

Text (SuperRL) - Accepted Version Pending embargo until 1 January 2100. Download (607kB)

Abstract

As AI becomes more prevalent throughout society, effective methods of integrating humans and AI systems that leverage their respective strengths and mitigate risk have become an important priority. In this paper, we introduce the paradigm of super policy learning that takes advantage of Human-AI interaction for data driven sequential decision making. This approach utilizes the observed action, either from AI or humans, as input for achieving a stronger oracle in policy learning for the decision maker (humans or AI). In the decision process with unmeasured confounding, the actions taken by past agents can offer valuable insights into undisclosed information. By including this information for the policy search in a novel and legitimate manner, the proposed super policy learning will yield a super-policy that is guaranteed to outperform both the standard optimal policy and the behavior one (e.g., past agents’ actions). We call this stronger oracle a blessing from human-AI interaction. Furthermore, to address the issue of unmeasured confounding in finding super-policies using the batch data, a number of nonparametric and causal identifications are established under the framework of proximal causal inference. Building upon on these novel identification results, we develop several super-policy learning algorithms and systematically study their theoretical properties such as finite-sample regret guarantee. Finally, we illustrate the effectiveness of our proposal through extensive simulations and real-world applications.

Item Type:	Article
Additional Information:	© 2025 The Author(s)
Divisions:	Statistics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science H Social Sciences > HA Statistics
Date Deposited:	30 Oct 2025 11:30
Last Modified:	31 Oct 2025 13:27
URI:	http://eprints.lse.ac.uk/id/eprint/130007

Actions (login required)

View Item