Predicting Human Performance in Vertical Menu Selection Using Deep Learning

Abstract : Predicting human performance in interaction tasks allows designers or developers to understand the expected performance of a target interface without actually testing it with real users. In this work, we present a deep neural net to model and predict human performance in performing a sequence of UI tasks. In particular, we focus on a dominant class of tasks, i.e., target selection from a vertical list or menu. We experimented with our deep neural net using a public dataset collected from a desktop laboratory environment and a dataset collected from hundreds of touchscreen smartphone users via crowdsourcing. Our model significantly outperformed previous methods on these datasets. Importantly, our method, as a deep model, can easily incorporate additional UI attributes such as visual appearance and content semantics without changing model architectures. By understanding about how a deep learning model learns from human behaviors, our approach can be seen as a vehicle to discover new patterns about human behaviors to advance analytical modeling.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [20 references]  Display  Hide  Download

https://hal.sorbonne-universite.fr/hal-01820431
Contributor : Gilles Bailly <>
Submitted on : Thursday, June 21, 2018 - 4:13:07 PM
Last modification on : Tuesday, March 26, 2019 - 1:29:24 AM
Document(s) archivé(s) le : Tuesday, September 25, 2018 - 10:05:58 PM

File

verticalMenuPerformance.pdf
Files produced by the author(s)

Identifiers

Citation

Yang Li, Samy Bengio, Gilles Bailly. Predicting Human Performance in Vertical Menu Selection Using Deep Learning. 2018 CHI Conference on Human Factors in Computing Systems, Apr 2018, Montréal, Canada. pp.29, ⟨10.1145/3173574.3173603⟩. ⟨hal-01820431⟩

Share

Metrics

Record views

76

Files downloads

42