On the Way to Improving Experimental Protocols to Evaluate Users' Trust in AI-Assisted Decision Making - Sorbonne Université
Other Publications Year : 2021

On the Way to Improving Experimental Protocols to Evaluate Users' Trust in AI-Assisted Decision Making

Abstract

The spread of AI-embedded systems involved in human decision making makes it critical to build these systems according to trustworthiness standards. To understand whether this goal was achieved, users' trust in these systems must be studied. However, empirically investigating trust is challenging. One reason is the lack of standard protocols to design trust experiments. To get an overview of the current practices in the experimental protocols for studying trust in the context of AI-assisted decision making, we conducted a systematic review of such papers. We annotated, categorized, and analyzed them along the constitutive elements of an experimental protocol (i.e., participants, task). Drawing from empirical practices in social and cognitive studies on human-human trust, we provide practical guidelines and research opportunities to improve the methodology of studying Human-AI trust in decision-making contexts. In this workshop, we would like to start the discussion about how these guidelines and research questions can be used in the laboratory and in the wild.
Fichier principal
Vignette du fichier
Workshop___Trustworthy___CHI_21.pdf (377.92 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03418712 , version 1 (08-11-2021)

Identifiers

  • HAL Id : hal-03418712 , version 1

Cite

Oleksandra Vereschak, Gilles Bailly, Baptiste Caramiaux. On the Way to Improving Experimental Protocols to Evaluate Users' Trust in AI-Assisted Decision Making. CHI’21 Workshop: Towards Explainable and Trustworthy Autonomous Physical Systems, 2021. ⟨hal-03418712⟩
163 View
94 Download

Share

More