MAGECally invert images for realistic editing - Sorbonne Université
Communication Dans Un Congrès Année : 2021

MAGECally invert images for realistic editing

Jean-François Goudou
  • Fonction : Auteur
Matthieu Cord

Résumé

Generative Adversarial Networks (GANs) are now able to generate astonishingly realistic high-resolution images. Recent work has shown the emergence of semanticallymeaningful manipulations simply by editing the corresponding latent vector. However, a real image must first be inverted into its GAN latent code before editing. Previous work usually achieves accurate reconstruction, but poor-quality latent vectors: applying known editing methods onto these latent codes results in artifacts and erroneous edits. We aim to bridge the gap between reconstruction and editability. We propose a novel instance-optimization based inversion method, which specifically aims to maximize the semantic information of the latent vector, all while producing an accurate reconstruction. We introduce the iMAGe-latEnt Consistency loss ("MAGEC"), which allows supervision in the latent space, encouraging editability of the resulting latent vector. We provide extensive qualitative and quantitative evaluation to validate our method, using the recent state-of-the-art StyleGAN and show that our method outperforms baseline inversion methods, opening the door to new realms of real-image editing.
Fichier principal
Vignette du fichier
Main Paper - 1394.pdf (29.88 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03504190 , version 1 (28-12-2021)

Identifiants

  • HAL Id : hal-03504190 , version 1

Citer

Asya Grechka, Jean-François Goudou, Matthieu Cord. MAGECally invert images for realistic editing. BMVC, Nov 2021, Online, United Kingdom. ⟨hal-03504190⟩
121 Consultations
62 Téléchargements

Partager

More