TY - JOUR
T1 - Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays
AU - Chakravarthula, Praneeth
AU - Zhang, Zhan
AU - Tursun, Okan
AU - Didyk, Piotr
AU - Sun, Qi
AU - Fuchs, Henry
N1 - Funding Information:
This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program (grant agreement No 804226 – PERDY), NSF grants 1840131 and 1405847, and a generous gift from Intel.
Publisher Copyright:
© 1995-2012 IEEE.
PY - 2021/11/1
Y1 - 2021/11/1
N2 - Computer-generated holographic (CGH) displays show great potential and are emerging as the next-generation displays for augmented and virtual reality, and automotive heads-up displays. One of the critical problems harming the wide adoption of such displays is the presence of speckle noise inherent to holography, that compromises its quality by introducing perceptible artifacts. Although speckle noise suppression has been an active research area, the previous works have not considered the perceptual characteristics of the Human Visual System (HVS), which receives the final displayed imagery. However, it is well studied that the sensitivity of the HVS is not uniform across the visual field, which has led to gaze-contingent rendering schemes for maximizing the perceptual quality in various computer-generated imagery. Inspired by this, we present the first method that reduces the 'perceived speckle noise' by integrating foveal and peripheral vision characteristics of the HVS, along with the retinal point spread function, into the phase hologram computation. Specifically, we introduce the anatomical and statistical retinal receptor distribution into our computational hologram optimization, which places a higher priority on reducing the perceived foveal speckle noise while being adaptable to any individual's optical aberration on the retina. Our method demonstrates superior perceptual quality on our emulated holographic display. Our evaluations with objective measurements and subjective studies demonstrate a significant reduction of the human perceived noise.
AB - Computer-generated holographic (CGH) displays show great potential and are emerging as the next-generation displays for augmented and virtual reality, and automotive heads-up displays. One of the critical problems harming the wide adoption of such displays is the presence of speckle noise inherent to holography, that compromises its quality by introducing perceptible artifacts. Although speckle noise suppression has been an active research area, the previous works have not considered the perceptual characteristics of the Human Visual System (HVS), which receives the final displayed imagery. However, it is well studied that the sensitivity of the HVS is not uniform across the visual field, which has led to gaze-contingent rendering schemes for maximizing the perceptual quality in various computer-generated imagery. Inspired by this, we present the first method that reduces the 'perceived speckle noise' by integrating foveal and peripheral vision characteristics of the HVS, along with the retinal point spread function, into the phase hologram computation. Specifically, we introduce the anatomical and statistical retinal receptor distribution into our computational hologram optimization, which places a higher priority on reducing the perceived foveal speckle noise while being adaptable to any individual's optical aberration on the retina. Our method demonstrates superior perceptual quality on our emulated holographic display. Our evaluations with objective measurements and subjective studies demonstrate a significant reduction of the human perceived noise.
KW - Holograms
KW - foveated rendering
KW - near-eye immersive displays
UR - http://www.scopus.com/inward/record.url?scp=85113903954&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85113903954&partnerID=8YFLogxK
U2 - 10.1109/TVCG.2021.3106433
DO - 10.1109/TVCG.2021.3106433
M3 - Article
C2 - 34449368
AN - SCOPUS:85113903954
SN - 1077-2626
VL - 27
SP - 4194
EP - 4203
JO - IEEE Transactions on Visualization and Computer Graphics
JF - IEEE Transactions on Visualization and Computer Graphics
IS - 11
ER -