Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment.

Last update: Dec 13, 2022

Overview

(ACMMM 2021 Oral) SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment

This repository shows two tasks: Face landmark detection and Face 3D reconstruction, which is described in this paper: Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment.

Installation

Clone the repository.
install dependencies.

pip install -r requirement.txt

Face landmark detection

Running a pre-trained model

Download landmark pre-trained model at GoogleDrive, and put it into FaceLandmark/model/
Run the test file

python Facial_landmark.py

Face 3D reconstruction

Running a pre-trained model

Download face 3D reconstruction pre-trained model at GoogleDrive, and put it into FaceReconstruction/checkpoints/
Run the inference.py file to generate disparity map

python inference.py --dataset-dir './FaceReconstruction/test_image/' --output-dir './FaceReconstruction/output/' --pretrained './FaceReconstruction/checkpoints/dispnet_model_best.pth.tar' --resnet-layers 18 --output-disp

Run the generate_ply.py file to generate point cloud .ply file

python generate_ply.py

Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment.

Related tags

Overview

(ACMMM 2021 Oral) SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment

Installation

Face landmark detection

Running a pre-trained model

Face 3D reconstruction

Running a pre-trained model

Owner

BoomStar

Official Implementation of VAT

PyTorch implementation for COMPLETER: Incomplete Multi-view Clustering via Contrastive Prediction (CVPR 2021)

[SIGGRAPH'22] StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

A JAX implementation of Broaden Your Views for Self-Supervised Video Learning, or BraVe for short.

Multi-tool reverse engineering collaboration solution.

A pytorch implementation of MBNET: MOS PREDICTION FOR SYNTHESIZED SPEECH WITH MEAN-BIAS NETWORK

Readings for "A Unified View of Relational Deep Learning for Polypharmacy Side Effect, Combination Therapy, and Drug-Drug Interaction Prediction."

PyTorch implementation HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections

A small demonstration of using WebDataset with ImageNet and PyTorch Lightning

Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision. ICCV 2021.

Official implementation of the RAVE model: a Realtime Audio Variational autoEncoder

Code for Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

PyTorch implementation of SampleRNN: An Unconditional End-to-End Neural Audio Generation Model

A PyTorch implementation of "SelfGNN: Self-supervised Graph Neural Networks without explicit negative sampling"

using yolox+deepsort for object-tracker

Code implementation for the paper 'Conditional Gaussian PAC-Bayes'.

Code for "3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop"

CoMoGAN: continuous model-guided image-to-image translation. CVPR 2021 oral.

Exposure Time Calculator (ETC) and radial velocity precision estimator for the Near InfraRed Planet Searcher (NIRPS) spectrograph

PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning