Skip to Main content Skip to Navigation
Conference papers

On leveraging crowdsourced data for automatic perceived stress detection

Abstract : Resorting to crowdsourcing platforms is a popular way to obtain annotations. Multiple potentially noisy answers can thus be aggregated to retrieve an underlying ground truth. However, it may be irrelevant to look for a unique ground truth when we ask crowd workers for opinions, notably when dealing with subjective phenomena such as stress. In this paper, we discuss how we can better use crowdsourced annotations with an application to automatic detection of perceived stress. Towards this aim, we first acquired video data from 44 subjects in a stressful situation and gathered answers to a binary question using a crowdsourcing platform. Then, we propose to integrate two measures derived from the set of gathered answers into the machine learning framework. First, we highlight that using the consensus level among crowd worker answers substantially increases classification accuracies. Then, we show that it is suitable to directly predict for each video the proportion of positive answers to the question from the different crowd workers. Hence, we propose a thorough study on how crowdsourced annotations can be used to enhance performance of classification and regression methods.
Complete list of metadata

https://hal.sorbonne-universite.fr/hal-02422960
Contributor : Mohamed Chetouani <>
Submitted on : Monday, December 23, 2019 - 2:44:55 PM
Last modification on : Wednesday, May 19, 2021 - 12:12:52 PM

Identifiers

Citation

Jonathan Aigrain, Arnaud Dapogny, Kevin Bailly, Séverine Dubuisson, Marcin Detyniecki, et al.. On leveraging crowdsourced data for automatic perceived stress detection. ICMI 2016 - 18th ACM International Conference on Multimodal Interaction, Nov 2016, Tokyo, Japan. pp.113-120, ⟨10.1145/2993148.2993200⟩. ⟨hal-02422960⟩

Share

Metrics

Record views

89