On leveraging crowdsourced data for automatic perceived stress detection - Sorbonne Université Access content directly
Conference Papers Year : 2016

On leveraging crowdsourced data for automatic perceived stress detection


Resorting to crowdsourcing platforms is a popular way to obtain annotations. Multiple potentially noisy answers can thus be aggregated to retrieve an underlying ground truth. However, it may be irrelevant to look for a unique ground truth when we ask crowd workers for opinions, notably when dealing with subjective phenomena such as stress. In this paper, we discuss how we can better use crowdsourced annotations with an application to automatic detection of perceived stress. Towards this aim, we first acquired video data from 44 subjects in a stressful situation and gathered answers to a binary question using a crowdsourcing platform. Then, we propose to integrate two measures derived from the set of gathered answers into the machine learning framework. First, we highlight that using the consensus level among crowd worker answers substantially increases classification accuracies. Then, we show that it is suitable to directly predict for each video the proportion of positive answers to the question from the different crowd workers. Hence, we propose a thorough study on how crowdsourced annotations can be used to enhance performance of classification and regression methods.
No file

Dates and versions

hal-02422960 , version 1 (23-12-2019)



Jonathan Aigrain, Arnaud Dapogny, Kevin Bailly, Séverine Dubuisson, Marcin Detyniecki, et al.. On leveraging crowdsourced data for automatic perceived stress detection. ICMI 2016 - 18th ACM International Conference on Multimodal Interaction, Nov 2016, Tokyo, Japan. pp.113-120, ⟨10.1145/2993148.2993200⟩. ⟨hal-02422960⟩
68 View
0 Download



Gmail Facebook X LinkedIn More