Joint neural phase retrieval and compression for energy- and computation-efficient holography on the edge

Yujie Wang, Praneeth Chakravarthula, Qi Sun, Baoquan Chen

    Research output: Contribution to journalArticlepeer-review


    Recent deep learning approaches have shown remarkable promise to enable high fidelity holographic displays. However, lightweight wearable display devices cannot afford the computation demand and energy consumption for hologram generation due to the limited onboard compute capability and battery life. On the other hand, if the computation is conducted entirely remotely on a cloud server, transmitting lossless hologram data is not only challenging but also result in prohibitively high latency and storage. In this work, by distributing the computation and optimizing the transmission, we propose the first framework that jointly generates and compresses high-quality phase-only holograms. Specifically, our framework asymmetrically separates the hologram generation process into high-compute remote encoding (on the server), and low-compute decoding (on the edge) stages. Our encoding enables light weight latent space data, thus faster and efficient transmission to the edge device. With our framework, we observed a reduction of 76% computation and consequently 83% in energy cost on edge devices, compared to the existing hologram generation methods. Our framework is robust to transmission and decoding errors, and approach high image fidelity for as low as 2 bits-per-pixel, and further reduced average bit-rates and decoding time for holographic videos.

    Original languageEnglish (US)
    Article number3530070
    JournalACM Transactions on Graphics
    Issue number4
    StatePublished - Jul 22 2022


    • Computer generated holography
    • Hologram compression
    • Neural hologram generation

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design


    Dive into the research topics of 'Joint neural phase retrieval and compression for energy- and computation-efficient holography on the edge'. Together they form a unique fingerprint.

    Cite this