This repo contains the source code for MobileHand, real-time estimation of 3D hand shape and pose from a single color image running at over 110 Hz on a GPU or 75 Hz on a CPU.
If you find MobileHand useful for your work, please consider citing
@inproceedings{MobileHand:2020,
title = {MobileHand: Real-time 3D Hand Shape and Pose Estimation from Color Image},
author = {Guan Ming, Lim and Prayook, Jatesiktat and Wei Tech, Ang},
booktitle = {27th International Conference on Neural Information Processing (ICONIP)},
year = {2020}
}The simplest way to run our implementation is to use anaconda and create an environment called mobilehand
conda env create -f environment.yaml
conda activate mobilehand
Next, download MANO right hand model
- Go to MANO project page
- Click on Sign In and register for your account
- Download Models & Code (
mano_v1_2.zip) - Unzip and copy the file
mano_v1_2/models/MANO_RIGHT.pklinto themobilehand/modelfolder
cd code/ # Change directory to the folder `mobilehand/code/`
python demo.py -m image -d stb # Test on sample image (STB dataset)
python demo.py -m image -d freihand # Test on sample image (FreiHAND dataset)
python demo.py -m video # Test on sample video
python demo.py -m camera # Test with webcam
python demo.py -m camera -c # Add -c to enable GPU processing
Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang
[ICCV 2019] FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images. [PDF] [Project] [Code]
Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox
[CVPR 2019] Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering. [PDF]
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim
Adnane Boukhayma, Rodrigo de Bem, Philip H.S. Torr
[CVPR 2019] 3D Hand Shape and Pose Estimation from a Single RGB Image. [PDF] [Project] [Code] (Oral)
Liuhao Ge, Zhou Ren, Yuncheng Li, Zehao Xue, Yingying Wang, Jianfei Cai, Junsong Yuan
[CVPR 2019] Learning joint reconstruction of hands and manipulated objects. [PDF] [Code] [Code] [Project]
Yana Hasson, Gül Varol, Dimitris Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, and Cordelia Schmid
Xiong Zhang*, Qiang Li*, Wenbo Zhang, Wen Zheng
[CVPR 2020] Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild. [PDF] [Project] (Oral)
Dominik Kulon, Riza Alp Güler, Iasonas Kokkinos, Michael Bronstein, Stefanos Zafeiriou
[CVPR 2020] Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data. [PDF] [Project] [Code]
Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu
Filippos Gouidis, Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros
Angjoo Kanazawa, Michael J Black, David W. Jacobs, Jitendra Malik
[SIGGRAPH ASIA 2017] Embodied Hands:Modeling and Capturing Hands and Bodies Together. [PDF] [Project]
Javier Romero, Dimitrios Tzionas, Michael J Black