End-to-end optimization of nonlinear transform codes for perceptual quality

Johannes Ballé, Valero Laparra, Eero P. Simoncelli

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We introduce a general framework for end-to-end optimization of the rate-distortion performance of nonlinear transform codes assuming scalar quantization. The framework can be used to optimize any differentiable pair of analysis and synthesis transforms in combination with any differentiable perceptual metric. As an example, we consider a code built from a linear transform followed by a form of multi-dimensional local gain control. Distortion is measured with a state-of-the-art perceptual metric. When optimized over a large database of images, this representation offers substantial improvements in bitrate and perceptual appearance over fixed (DCT) codes, and over linear transform codes optimized for mean squared error.

Original languageEnglish (US)
Title of host publication2016 Picture Coding Symposium, PCS 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509059669
DOIs
StatePublished - Apr 19 2017
Event2016 Picture Coding Symposium, PCS 2016 - Nuremberg, Germany
Duration: Dec 4 2016Dec 7 2016

Publication series

Name2016 Picture Coding Symposium, PCS 2016

Other

Other2016 Picture Coding Symposium, PCS 2016
CountryGermany
CityNuremberg
Period12/4/1612/7/16

ASJC Scopus subject areas

  • Media Technology
  • Signal Processing

Fingerprint Dive into the research topics of 'End-to-end optimization of nonlinear transform codes for perceptual quality'. Together they form a unique fingerprint.

Cite this