Illusion of knowledge in statistics among clinicians: evaluating the alignment between objective accuracy and subjective confidence, an online survey - Sorbonne Université
Article Dans Une Revue Cognitive Research: Principles and Implications Année : 2023

Illusion of knowledge in statistics among clinicians: evaluating the alignment between objective accuracy and subjective confidence, an online survey

Résumé

Healthcare professionals' statistical illiteracy can impair medical decision quality and compromise patient safety. Previous studies have documented clinicians' insufficient proficiency in statistics and a tendency in overconfidence. However, an underexplored aspect is clinicians' awareness of their lack of statistical knowledge that precludes any corrective intervention attempt. Here, we investigated physicians' , residents' and medical students' alignment between subjective confidence judgments and objective accuracy in basic medical statistics. We also examined how gender, profile of experience and practice of research activity affect this alignment, and the influence of problem framing (conditional probabilities, CP vs. natural frequencies, NF). Eight hundred ninety-eight clinicians completed an online survey assessing skill and confidence on three topics: vaccine efficacy, p value and diagnostic test results interpretation. Results evidenced an overall consistent poor proficiency in statistics often combined with high confidence, even in incorrect answers. We also demonstrate that despite overconfidence bias, clinicians show a degree of metacognitive sensitivity, as their confidence judgments discriminate between their correct and incorrect answers. Finally, we confirm the positive impact of the more intuitive NF framing on accuracy. Together, our results pave the way for the development of teaching recommendations and pedagogical interventions such as promoting metacognition on basic knowledge and statistical reasoning as well as the use of NF to tackle statistical illiteracy in the medical context.
Fichier principal
Vignette du fichier
s41235-023-00474-1.pdf (7.08 Mo) Télécharger le fichier
Origine Publication financée par une institution
Licence

Dates et versions

hal-04076913 , version 1 (21-04-2023)

Licence

Identifiants

Citer

Camille Lakhlifi, François-Xavier Lejeune, Marion Rouault, Mehdi Khamassi, Benjamin Rohaut. Illusion of knowledge in statistics among clinicians: evaluating the alignment between objective accuracy and subjective confidence, an online survey. Cognitive Research: Principles and Implications, 2023, 8, ⟨10.1186/s41235-023-00474-1⟩. ⟨hal-04076913⟩
45 Consultations
79 Téléchargements

Altmetric

Partager

More