Skip to Main content Skip to Navigation
Conference papers

Which Discriminator for Cooperative Text Generation?

Antoine Chaffin 1, 2 Thomas Scialom 3, 4 Sylvain Lamprier 4 Jacopo Staiano 3 Benjamin Piwowarski 4 Ewa Kijak 5 Vincent Claveau 5 
2 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - SIGNAL, IMAGE ET LANGAGE
4 MLIA - Machine Learning and Information Access
ISIR - Institut des Systèmes Intelligents et de Robotique
5 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : Language models generate texts by successively predicting probability distributions for next tokens given past ones. A growing field of interest tries to leverage external information in the decoding process so that the generated texts have desired properties, such as being more natural, non toxic, faithful, or having a specific writing style. A solution is to use a classifier at each generation step, resulting in a cooperative environment where the classifier guides the decoding of the language model distribution towards relevant texts for the task at hand. In this paper, we examine three families of (transformer-based) discriminators for this specific task of cooperative decoding: bidirectional, left-to-right and generative ones. We evaluate the pros and cons of these different types of discriminators for cooperative generation, exploring respective accuracy on classification tasks along with their impact on the resulting sample quality and computational performances. We also provide the code of a batched implementation of the powerful cooperative decoding strategy used for our experiments, the Monte Carlo Tree Search, working with each discriminator for Natural Language Generation.
Complete list of metadata

https://hal.sorbonne-universite.fr/hal-03718429
Contributor : Benjamin Piwowarski Connect in order to contact the contributor
Submitted on : Friday, July 8, 2022 - 5:28:12 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM

Links full text

Identifiers

Citation

Antoine Chaffin, Thomas Scialom, Sylvain Lamprier, Jacopo Staiano, Benjamin Piwowarski, et al.. Which Discriminator for Cooperative Text Generation?. SIGIR 2022 - 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Jul 2022, Madrid Spain, France. pp.2360-2365, ⟨10.1145/3477495.3531858⟩. ⟨hal-03718429⟩

Share

Metrics

Record views

0