Inspirational Adversarial Image Generation

Baptiste Roziere, Morgane Riviere, Olivier Teytaud, Jeremy Rapin, Yann Lecun, Camille Couprie

Research output: Contribution to journalArticlepeer-review

Abstract

The task of image generation started receiving some attention from artists and designers, providing inspiration for new creations. However, exploiting the results of deep generative models such as Generative Adversarial Networks can be long and tedious given the lack of existing tools. In this work, we propose a simple strategy to inspire creators with new generations learned from a dataset of their choice, while providing some control over the output. We design a simple optimization method to find the optimal latent parameters corresponding to the closest generation to any input inspirational image. Specifically, we allow the generation given an inspirational image of the user's choosing by performing several optimization steps to recover optimal parameters from the model's latent space. We tested several exploration methods from classical gradient descents to gradient-free optimizers. Many gradient-free optimizers just need comparisons (better/worse than another image), so they can even be used without numerical criterion nor inspirational image, only with human preferences. Thus, by iterating on one's preferences we can make robust facial composite or fashion generation algorithms. Our results on four datasets of faces, fashion images, and textures show that satisfactory images are effectively retrieved in most cases.

Original languageEnglish (US)
Article number9381602
Pages (from-to)4036-4045
Number of pages10
JournalIEEE Transactions on Image Processing
Volume30
DOIs
StatePublished - 2021

Keywords

  • Optimization
  • generative adversarial networks
  • similarity search

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Inspirational Adversarial Image Generation'. Together they form a unique fingerprint.

Cite this