Skip to Main content Skip to Navigation
Conference papers

Fine-tuning Siamese Networks to Assess Sport Gestures Quality

Abstract : This paper presents an Action Quality Assessment (AQA) approach that learns to automatically score action realization from temporal sequences like videos. To manage the small size of most of databases capturing actions or gestures, we propose to use Siamese Networks. In the literature, Siamese Networks are widely used to rank action scores. Indeed, their purpose is not to regress scores but to predict a value that respects true scores order so that it can be used to rank actions according to their quality. For AQA, we need to predict real scores, as well as the difference between these scores and their range. Thus, we first introduce a new loss function to train Siamese Networks in order to regress score gaps. Once the Siamese network is trained, a branch of this network is extracted and fine-tuned for score prediction. We tested our approach on a public database, the AQA-7 dataset, composed of videos from 7 sports. Our results outperform state of the art on AQA task. Moreover, we show that the proposed method is also more efficient for action ranking.
Document type :
Conference papers
Complete list of metadata

Cited literature [30 references]  Display  Hide  Download

https://hal.sorbonne-universite.fr/hal-02933258
Contributor : Catherine Achard <>
Submitted on : Tuesday, September 8, 2020 - 11:50:31 AM
Last modification on : Thursday, May 20, 2021 - 3:36:46 AM
Long-term archiving on: : Wednesday, December 2, 2020 - 10:32:48 PM

File

VISAPP.pdf
Files produced by the author(s)

Identifiers

Citation

Mégane Millan, Catherine Achard. Fine-tuning Siamese Networks to Assess Sport Gestures Quality. 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020, Feb 2020, Valetta, Malta. ⟨10.5220/0008924600570065⟩. ⟨hal-02933258⟩

Share

Metrics

Record views

74

Files downloads

99