A TensorFlow implementation of the Mnemonic Descent Method.

Last update: Oct 07, 2022

Overview

MDM

A Tensorflow implementation of the Mnemonic Descent Method.

Mnemonic Descent Method: A recurrent process applied for end-to-end face alignment
G. Trigeorgis, P. Snape, M. A. Nicolaou, E. Antonakos, S. Zafeiriou.
Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition (CVPR'16).
Las Vegas, NV, USA, June 2016.

Installation Instructions

Menpo

We are an avid supporter of the Menpo project (http://www.menpo.org/) which we use in various ways throughout the implementation.

Please look at the installation instructions at:

http://www.menpo.org/installation/

TensorFlow

Follow the installation instructions of Tensorflow at and install it inside the conda enviroment you have created

https://www.tensorflow.org/versions/r0.9/get_started/os_setup.html#installing-from-sources

but use

git clone https://github.com/trigeorgis/tensorflow.git

as the TensorFlow repo. This is a fork of Tensorflow (#ff75787c) but it includes some extra C++ ops, such as for the extraction of patches around the landmarks.

Pretrained models

Disclaimer: The pretrained models can only be used for non-commercial academic purposes.

A pretrained model on 300W train set can be found at: https://www.doc.ic.ac.uk/~gt108/theano_mdm.pb

Training a model

Currently the TensorFlow implementation does not contain the same data augmnetation steps as we did in the paper, but this will be updated shortly.

    # Activate the conda environment where tf/menpo resides.
    source activate menpo
    
    # Start training
    python mdm_train.py --datasets='databases/lfpw/trainset/*.png:databases/afw/*.jpg:databases/helen/trainset/*.jpg'
    
    # Track the train process and evaluate the current checkpoint against the validation set
    python mdm_eval.py --dataset_path="./databases/ibug/*.jpg" --num_examples=135 --eval_dir=ckpt/eval_ibug  --device='/cpu:0' --checkpoint_dir=$PWD/ckpt/train
    
    python mdm_eval.py --dataset_path="./databases/lfpw/testset/*.png" --num_examples=300 --eval_dir=ckpt/eval_lfpw  --device='/cpu:0' --checkpoint_dir=$PWD/ckpt/train
    
    python mdm_eval.py --dataset_path="./databases/helen/testset/*.jpg" --num_examples=330 --eval_dir=ckpt/eval_helen  --device='/cpu:0' --checkpoint_dir=$PWD/ckpt/train
    
    # Run tensorboard to visualise the results
    tensorboard --logdir==$PWD/ckpt

A TensorFlow implementation of the Mnemonic Descent Method.

Related tags

Overview

MDM

Installation Instructions

Menpo

TensorFlow

Pretrained models

Training a model

Owner

Learning with Noisy Labels via Sparse Regularization, ICCV2021

Detection of drones using their thermal signatures from thermal camera through YOLO-V3 based CNN with modifications to encapsulate drone motion

The official implementation of the paper, "SubTab: Subsetting Features of Tabular Data for Self-Supervised Representation Learning"

HomoInterpGAN - Homomorphic Latent Space Interpolation for Unpaired Image-to-image Translation

Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bank

Repository for the paper "Exploring the Sensory Spaces of English Perceptual Verbs in Natural Language Data"

Code for Understanding Pooling in Graph Neural Networks

source code for https://arxiv.org/abs/2005.11248 "Accelerating Antimicrobial Discovery with Controllable Deep Generative Models and Molecular Dynamics"

Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

A crossplatform menu bar application using mpv as DLNA Media Renderer.

Official code repository for the publication "Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neurons"

Unofficial implementation of the Involution operation from CVPR 2021

Structure-Preserving Deraining with Residue Channel Prior Guidance (ICCV2021)

[ICML 2022] The official implementation of Graph Stochastic Attention (GSAT).

The Pytorch implementation for "Video-Text Pre-training with Learned Regions"

This is the pytorch implementation for the paper: Generalizable Mixed-Precision Quantization via Attribution Rank Preservation, which is accepted to ICCV2021.

This is the official code for the paper "Tracker Meets Night: A Transformer Enhancer for UAV Tracking".

Official PyTorch implementation of the paper Image-Based CLIP-Guided Essence Transfer.

TCNN Temporal convolutional neural network for real-time speech enhancement in the time domain

UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation