An Assistive Technology Based on Object Detection for Automated Task List Generation - INSA CENTRE VAL DE LOIRE
Communication Dans Un Congrès Année : 2024

An Assistive Technology Based on Object Detection for Automated Task List Generation

Résumé

People suffering from Intellectual Disability (ID) face challenges to perform sequential tasks in their daily life, impacting their education and employability. To help them, the usage of Assistive Technology (AT) on mobile devices is a promising direction. However, most of them do not take advantage of the important recent advances in Artificial Intelligence. In this paper, we address this lack by presenting a prototype of an embed AT system that leverage computer vision advances to assist a user suffering from ID to perform sequential tasks in a guesthouse rooms’ tiding-up activity. It first relies on a state-of-the-art object detector, namely YOLOv7, that we have adapted for a real-time usage on mobile devices. Then, using a ”spot the difference” approach, it identifies objects of interest that are either present, absent or displaced, compared to a template image. A list of tasks to be achieved is automatically generated and conveyed to the user using an accessible and ergonomic i nterface. Early qualitative experiments of this ongoing work lead us to believe that our contribution could improve the life of people suffering from ID, allowing them to improve both their functioning and independence.
Fichier principal
Vignette du fichier
RAYAR_Frederic_VISAPP2024_Lili.pdf (1.71 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04836191 , version 1 (13-12-2024)

Identifiants

Citer

Frédéric Rayar. An Assistive Technology Based on Object Detection for Automated Task List Generation. 19th International Conference on Computer Vision Theory and Applications, Feb 2024, Rome, France. pp.601-605, ⟨10.5220/0012453200003660⟩. ⟨hal-04836191⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More