Abstract
We propose an efficient methodology for comparing computational models of a perceptually discriminable quantity. Rather than comparing model responses to subjective responses on a set of pre-selected stimuli, the stimuli are computer-synthesized so as to optimally distinguish the models. Specifically, given two computational models that take a stimulus as an input and predict a perceptually discriminable quantity, we first synthesize a pair of stimuli that maximize/minimize the response of one model while holding the other fixed. We then repeat this procedure, but with the roles of the two models reversed. Subjective testing on pairs of such synthesized stimuli provides a strong indication of the relative strengths and weaknesses of the two models. Specifically, the model whose extremal stimulus pairs are easier for subjects to discriminate is the better model. Moreover, careful study of the synthesized stimuli may suggest potential ways to improve a model or to combine aspects of multiple models. We demonstrate the methodology for two example perceptual quantities: contrast and image quality.
Original language | English (US) |
---|---|
Article number | 8 |
Journal | Journal of vision |
Volume | 8 |
Issue number | 12 |
DOIs | |
State | Published - Sep 23 2008 |
Keywords
- Contrast perception
- Image quality assessment
- Maximum differentiation competition
- Model comparison
- Perceptual discriminability
- Stimulus synthesis
ASJC Scopus subject areas
- Ophthalmology
- Sensory Systems