Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment.

Last update: Dec 13, 2022

Overview

(ACMMM 2021 Oral) SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment

This repository shows two tasks: Face landmark detection and Face 3D reconstruction, which is described in this paper: Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment.

Installation

Clone the repository.
install dependencies.

pip install -r requirement.txt

Face landmark detection

Running a pre-trained model

Download landmark pre-trained model at GoogleDrive, and put it into FaceLandmark/model/
Run the test file

python Facial_landmark.py

Face 3D reconstruction

Running a pre-trained model

Download face 3D reconstruction pre-trained model at GoogleDrive, and put it into FaceReconstruction/checkpoints/
Run the inference.py file to generate disparity map

python inference.py --dataset-dir './FaceReconstruction/test_image/' --output-dir './FaceReconstruction/output/' --pretrained './FaceReconstruction/checkpoints/dispnet_model_best.pth.tar' --resnet-layers 18 --output-disp

Run the generate_ply.py file to generate point cloud .ply file

python generate_ply.py

Deep Unsupervised 3D SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment.

Related tags

Overview

(ACMMM 2021 Oral) SfM Face Reconstruction Based on Massive Landmark Bundle Adjustment

Installation

Face landmark detection

Running a pre-trained model

Face 3D reconstruction

Running a pre-trained model

Owner

BoomStar

This is the unofficial code of Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes. which achieve state-of-the-art trade-off between accuracy and speed on cityscapes and camvid, without using inference acceleration and extra data

History Aware Multimodal Transformer for Vision-and-Language Navigation

CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation

Vision Transformer for 3D medical image registration (Pytorch).

Self-labelling via simultaneous clustering and representation learning. (ICLR 2020)

An pytorch implementation of Masked Autoencoders Are Scalable Vision Learners

Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper

The code for paper "Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representation" which is accepted by AAAI 2022

Survival analysis (SA) is a well-known statistical technique for the study of temporal events.

PyStan, a Python interface to Stan, a platform for statistical modeling. Documentation: https://pystan.readthedocs.io

[ICML 2021] “ Self-Damaging Contrastive Learning”, Ziyu Jiang, Tianlong Chen, Bobak Mortazavi, Zhangyang Wang

BOOKSUM: A Collection of Datasets for Long-form Narrative Summarization

PushForKiCad - AISLER Push for KiCad EDA

Joint Channel and Weight Pruning for Model Acceleration on Mobile Devices

EGNN - Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch

PyTorch and GPyTorch implementation of the paper "Conditioning Sparse Variational Gaussian Processes for Online Decision-making."

Contains code for the paper "Vision Transformers are Robust Learners".

Everything about being a TA for ITP/AP course!

Code for paper entitled "Improving Novelty Detection using the Reconstructions of Nearest Neighbours"

Code for our paper Aspect Sentiment Quad Prediction as Paraphrase Generation in EMNLP 2021.