Thermal to Visible Face Recognition Using Deep Autoencoders

Alperen Kantarci, Hazim Kemal Ekenel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Visible face recognition systems achieve nearly perfect recognition accuracies using deep learning. However, in lack of light, these systems perform poorly. A way to deal with this problem is thermal to visible cross-domain face matching. This is a desired technology because of its usefulness in night time surveillance. Nevertheless, due to differences between two domains, it is a very challenging face recognition problem. In this paper, we present a deep autoencoder based system to learn the mapping between visible and thermal face images. Also, we assess the impact of alignment in thermal to visible face recognition. For this purpose, we manually annotate the facial landmarks on the Carl and EURECOM datasets. The proposed approach is extensively tested on three publicly available datasets: Carl, UND-X1, and EURECOM. Experimental results show that the proposed approach improves the state-of-the-art significantly. We observe that alignment increases the performance by around 2%. Annotated facial landmark positions in this study can be downloaded from the following link: github.com/Alpkant/Thermal-to-Visible-Face-Recognition- Using-Deep-Autoencoders .

Original languageEnglish (US)
Title of host publicationBIOSIG 2019 - Proceedings of the 18th International Conference of the Biometrics Special Interest Group
EditorsArslan Bromme, Christoph Busch, Antitza Dantcheva, Andreas Uhl
PublisherGesellschaft fur Informatik (GI)
Pages213-220
Number of pages8
ISBN (Electronic)9783885796909
StatePublished - 2019
Event18th International Conference of the Biometrics Special Interest Group, BIOSIG 2019 - Darmstadt, Germany
Duration: Sep 18 2019Sep 20 2019

Publication series

NameLecture Notes in Informatics (LNI), Proceedings - Series of the Gesellschaft fur Informatik (GI)
VolumeP-296
ISSN (Print)1617-5468

Conference

Conference18th International Conference of the Biometrics Special Interest Group, BIOSIG 2019
Country/TerritoryGermany
CityDarmstadt
Period9/18/199/20/19

Keywords

  • autoencoders
  • Convolutional neural networks
  • heterogeneous face recognition
  • thermal to visible matching

ASJC Scopus subject areas

  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Thermal to Visible Face Recognition Using Deep Autoencoders'. Together they form a unique fingerprint.

Cite this