On the Way to Improving Experimental Protocols to Evaluate Users' Trust in AI-Assisted Clinical Decision Making - Sorbonne Université
Autre Publication Scientifique Année : 2021

On the Way to Improving Experimental Protocols to Evaluate Users' Trust in AI-Assisted Clinical Decision Making

Résumé

The spread of AI-embedded systems involved in medical decision making makes it critical to build these systems according to trustworthiness standards. However, empirically investigating trust is challenging. One reason is the lack of standard protocols to design trust experiments. To get an overview of the current practices in the experimental protocols for studying trust in the context of AI-assisted decision making, we conducted a systematic review of such papers. We annotated, categorized, and analyzed them along the constitutive elements of an experimental protocol (i.e., participants, task). Drawing from empirical practices in social and cognitive studies on human-human trust, we provide practical guidelines and research opportunities to ameliorate the methodology of studying Human-AI trust in medical decision-making contexts. In this workshop, we would like to discuss how these insights could improve the quality of data about users' trust and, thus, lead to new steps towards closing the "last mile" between AI and healthcare workers.
Fichier principal
Vignette du fichier
Workshop___AIHealth___CHI_21.pdf (468.49 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03418706 , version 1 (08-11-2021)

Identifiants

  • HAL Id : hal-03418706 , version 1

Citer

Oleksandra Vereschak, Gilles Bailly, Baptiste Caramiaux. On the Way to Improving Experimental Protocols to Evaluate Users' Trust in AI-Assisted Clinical Decision Making. CHI’21 Workshop: Realizing AI in Healthcare: Challenges Appearing in the Wild, 2021. ⟨hal-03418706⟩
221 Consultations
122 Téléchargements

Partager

More