Cross-Dataset Face Manipulation Detection

Burak Bekci, Zahid Akhtar, Hazim Kemal Ekenel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Easily available recent face image/video manipulation techniques and tools are now being utilized to generate highly realistic manipulated videos known as DeepFakes, which can fool face recognition systems and humans. Thus, it is vital to devise precise manipulation detection methods. Despite the progress, existing mechanisms are limited to the datasets or manipulation types. In this paper, to increase the performance under unseen data and manipulations, a DeepFakes detection framework using metric learning and steganalysis rich models is presented. Extensive empirical analysis on three publicly available datasets, namely, FaceForensics++, CelebDF, and DeepFakeTIMIT, were carried out to evaluate the generalization capability of the proposed approach. The framework attained 5% to 15% accuracy gains under unseen manipulations.

Original languageEnglish (US)
Title of host publication2020 28th Signal Processing and Communications Applications Conference, SIU 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728172064
DOIs
StatePublished - Oct 5 2020
Event28th Signal Processing and Communications Applications Conference, SIU 2020 - Gaziantep, Turkey
Duration: Oct 5 2020Oct 7 2020

Publication series

Name2020 28th Signal Processing and Communications Applications Conference, SIU 2020 - Proceedings

Conference

Conference28th Signal Processing and Communications Applications Conference, SIU 2020
Country/TerritoryTurkey
CityGaziantep
Period10/5/2010/7/20

Keywords

  • Deep Learning
  • DeepFake
  • Face Manipulation
  • Generalization
  • Metric Learning

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Signal Processing

Fingerprint

Dive into the research topics of 'Cross-Dataset Face Manipulation Detection'. Together they form a unique fingerprint.

Cite this