Perceptual quality assessment of color images using adaptive signal representation

Umesh Rajashekar, Zhou Wang, Eero P. Simoncelli

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Perceptual image distortion measures can play a fundamental role in evaluating and optimizing imaging systems and image processing algorithms. Many existing measures are formulated to represent "just noticeable differences" (JNDs), as measured in psychophysical experiments on human subjects. But some image distortions, such as those arising from small changes in the intensity of the ambient illumination, are far more tolerable to human observers than those that disrupt the spatial structure of intensities and colors. Here, we introduce a framework in which we quantify these perceptual distortions in terms of "just intolerable differences" (JIDs). As in (Wang & Simoncelli, Proc. ICIP 2005), we first construct a set of spatio-chromatic basis functions to approximate (as a first-order Taylor series) a set of "non-structural" distortions that result from changes in lighting/imaging/viewing conditions. These basis functions are defined on local image patches, and are adaptive, in that they are computed as functions of the undistorted reference image. This set is then augmented with a complete basis arising from a linear approximation of the CIELAB color space. Each basis function is weighted by a scale factor to convert it into units corresponding to JIDs. Each patch of the error image is represented using this weighted overcomplete basis, and the overall distortion metric is computed by summing the squared coefficients over all such (overlapping) patches. We implement an example of this metric, incorporating invariance to small changes in the viewing and lighting conditions, and demonstrate that the resulting distortion values are more consistent with human perception than those produced by CIELAB or S-CIELAB.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Human Vision and Electronic Imaging XV
StatePublished - 2010
EventHuman Vision and Electronic Imaging XV - San Jose, CA, United States
Duration: Jan 18 2010Jan 21 2010

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


OtherHuman Vision and Electronic Imaging XV
Country/TerritoryUnited States
CitySan Jose, CA


  • Adaptive signal decomposition
  • Color image quality assessment

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Perceptual quality assessment of color images using adaptive signal representation'. Together they form a unique fingerprint.

Cite this