PyDeepFakeDet

An integrated and scalable library for Deepfake detection research.

Introduction

PyDeepFakeDet is an integrated and scalable Deepfake detection tool developed by Fudan Vision and Learning Lab. The goal is to provide state-of-the-art Deepfake detection Models as well as interfaces for the training and evaluation of new Models on commonly used Deepfake datasets.

This repository includes implementations of both CNN-based and Transformer-based methods:

• CNN Models

  • ResNet
  • Xception
  • EfficientNet
  • MesoNet
  • GramNet
  • Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues
  • Multi-attentional Deepfake Detection

• Transformer Models

  • ViT
  • M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection

Model Zoo and Baselines

The baseline Models on three versions of FF-DF dataset are provided.

The baseline Models on Celeb-DF is also available.

Installation

• We use Python == 3.9.0, torch==1.11.0, torchvision==1.12.0.

• Install the required packages by:

  pip install -r requirements.txt

Data Preparation

Please follow the instructions in DATASET.md to prepare the data.

Quick Start

Specify the path of your local dataset in ./configs/resnet50.yaml, and then run:

python run.py --cfg resnet50.yaml

Visualization tools

Please refer to VISUALIZE.md for detailed instructions.

Contributors

PyDeepFakeDet is written and maintained by Wenhao Ouyang, Chao Zhang, Zhenxin Li, and Junke Wang.

License

PyDeepFakeDet is released under the MIT license.

Citations

@inproceedings{wang2021m2tr,
  title={M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection},
  author={Wang, Junke and Wu, Zuxuan and Ouyang, Wenhao and Han, Xintong and Chen, Jingjing and Lim, Ser-Nam and Jiang, Yu-Gang},
  booktitle={ICMR},
  year={2022}
}