A Dataless FaceSwap Detection Approach Using Synthetic Images

Anubhav Jain, Nasir Memon, Julian Togelius

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Face swapping technology used to create 'Deepfakes' has advanced significantly over the past few years and now enables us to create realistic facial manipulations. Current deep learning algorithms to detect deepfakes have shown promising results, however, they require large amounts of training data, and as we show they are biased towards a particular ethnicity. We propose a deepfake detection methodology that eliminates the need for any real data by making use of synthetically generated data using Style-GAN3. This not only performs at par with the traditional training methodology of using real data but it shows better generalization capabilities when finetuned with a small amount of real data. Furthermore, this also reduces biases created by facial image datasets that might have sparse data from particular ethnicities. To promote reproducibility the code base has been made publicly available 11https://github.com/anubhav1997/youneednodataset

Original languageEnglish (US)
Title of host publication2022 IEEE International Joint Conference on Biometrics, IJCB 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665463942
DOIs
StatePublished - 2022
Event2022 IEEE International Joint Conference on Biometrics, IJCB 2022 - Abu Dhabi, United Arab Emirates
Duration: Oct 10 2022Oct 13 2022

Publication series

Name2022 IEEE International Joint Conference on Biometrics, IJCB 2022

Conference

Conference2022 IEEE International Joint Conference on Biometrics, IJCB 2022
Country/TerritoryUnited Arab Emirates
CityAbu Dhabi
Period10/10/2210/13/22

ASJC Scopus subject areas

  • Agricultural and Biological Sciences (miscellaneous)
  • Computer Vision and Pattern Recognition
  • Health Informatics
  • Instrumentation

Fingerprint

Dive into the research topics of 'A Dataless FaceSwap Detection Approach Using Synthetic Images'. Together they form a unique fingerprint.

Cite this