The conversational action test: detecting the artificial sociality of artificial intelligence

Albert, Saul, Housley, William, Sikveland, Rein Ove and Stokoe, Elizabeth ORCID: 0000-0002-7353-4121 (2025) The conversational action test: detecting the artificial sociality of artificial intelligence. New Media & Society, 27 (10). 5592 - 5621. ISSN 1461-4448

Text (albert-et-al-2025-the-conversational-action-test-detecting-the-artificial-sociality-of-artificial-intelligence) - Published Version Available under License Creative Commons Attribution. Download (398kB)

Abstract

Drawing on the “Voigt-Kampff Empathy Test”—a science fiction version of Turing’s famous thought experiment—we propose the Conversational Action Test (CAT): a new approach to evaluating conversational artificial intelligence (AI) voice agents. We compare social actions in a range of telephone service encounters where one party is an artificial conversational agent to a range of similar human-human calls. The CAT demonstrates a novel paradigm that addresses long-standing theoretical and methodological problems for ostensible “tests” of conversational AI by (a) revealing the conceptual confusion of attempting to “detect” an AI in routine service interactions and (b) focusing, instead, on the situated interactional practices through which an AI “passes” for human. We discuss the implications of the CAT for the design and evaluation of conversational AI, and for the notion of “humanness” as a goal or benchmark for such systems. Data include publicly available human/AI service calls and comparable human-human calls in British and American English.

Item Type:	Article
Additional Information:	© 2025 The Author(s)
Divisions:	Psychological and Behavioural Science
Subjects:	B Philosophy. Psychology. Religion > BF Psychology Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Date Deposited:	02 Dec 2024 17:51
Last Modified:	06 Oct 2025 15:00
URI:	http://eprints.lse.ac.uk/id/eprint/126216

Actions (login required)

View Item