Investigating low-delay deep learning-based cultural image reconstruction

Abdelhak Belhi, Abdulaziz Khalid Al-Ali, Abdelaziz Bouras, Sebti Foufou, Xi Yu, Haiqing Zhang

Research output: Contribution to journalArticle

Abstract

Numerous cultural assets host a great historical and moral value, but due to their degradation, this value is heavily affected as their attractiveness is lost. One of the solutions that most heritage organizations and museums currently choose is to leverage the knowledge of art and history experts in addition to curators to recover and restore the damaged assets. This process is labor-intensive, expensive and more often results in just an assumption over the damaged or missing region. In this work, we tackle the issue of completing missing regions in artwork through advanced deep learning and image reconstruction (inpainting) techniques. Following our analysis of different image completion and reconstruction approaches, we noticed that these methods suffer from various limitations such as lengthy processing times and hard generalization when trained with multiple visual contexts. Most of the existing learning-based image completion and reconstruction techniques are trained on large datasets with the objective of retrieving the original data distribution of the training samples. However, this distribution becomes more complex when the training data is diverse making the training process difficult and the reconstruction inefficient. Through this paper, we present a clustering-based low-delay image completion and reconstruction approach which combines supervised and unsupervised learning to address the highlighted issues. We compare our technique to the current state of the art using a real-world dataset of artwork collected from various cultural institutions. Our approach is evaluated using statistical methods and a surveyed audience to better interpret our results objectively and subjectively.

Original languageEnglish (US)
JournalJournal of Real-Time Image Processing
DOIs
StateAccepted/In press - 2020

Keywords

  • Deep learning
  • Digital heritage
  • Image clustering
  • Image inpainting
  • Image reconstruction
  • Low-delay reconstruction

ASJC Scopus subject areas

  • Information Systems

Fingerprint Dive into the research topics of 'Investigating low-delay deep learning-based cultural image reconstruction'. Together they form a unique fingerprint.

  • Cite this