HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Self-Attention Architectures for Answer-Agnostic Neural Question Generation

Abstract : Neural architectures based on self-attention, such as Transformers, recently attracted interest from the research community, and obtained significant improvements over the state of the art in several tasks. We explore how Transformers can be adapted to the task of Neural Question Generation without constraining the model to focus on a specific answer passage. We study the effect of several strategies to deal with out-of-vocabulary words such as copy mechanisms, placeholders, and contextual word embeddings. We report improvements obtained over the state-of-the-art on the SQuAD dataset according to automated metrics (BLEU, ROUGE), as well as qualitative human assessments of the system outputs.
Complete list of metadata

Contributor : Benjamin Piwowarski Connect in order to contact the contributor
Submitted on : Wednesday, November 6, 2019 - 11:19:32 AM
Last modification on : Tuesday, January 4, 2022 - 5:50:43 AM



Thomas Scialom, Benjamin Piwowarski, Jacopo Staiano. Self-Attention Architectures for Answer-Agnostic Neural Question Generation. ACL 2019 - Annual Meeting of the Association for Computational Linguistics, Jul 2019, Florence, Italy. pp.6027-6032, ⟨10.18653/v1/P19-1604⟩. ⟨hal-02350993⟩



Record views