🏃‍♀️ A curated list about human motion capture, analysis and synthesis.

Overview

Awesome Human Motion Awesome

🏃‍♀️ A curated list about human motion capture, analysis and synthesis.

Contents

Introduction

Human Models

  • SMPL - SMPL is a realistic 3D model of the human body that is based on skinning and blend shapes and is learned from thousands of 3D body scans.
  • MakeHuman - MakeHuman is an open source (AGPL3) tool designed to simplify the creation of virtual humans using a Graphical User Interface, also commonly referred to as a GUI.

Datasets

  • Human 3.6M - Large Scale Datasets and Predictive Methodsfor 3D Human Sensing in Natural Environments
  • SURREAL - Learning from Synthetic Humans, CVPR 2017
  • CMU - Carnegie Mellon University Motion Capture Database
  • Berkley MHAD - [ 📷 🎥 🎤 🤾‍♀️ ⌚️ 🤹‍♀️ ][ 👨‍🦰 👩 ][ 👧 👵 ] - The Berkeley Multimodal Human Action Database (MHAD) contains 11 actions performed by 7 male and 5 female subjects in the range 23-30 years of age except for one elderly subject.
  • COCO - [ 📷 ][ 👨‍🦰 👩 ][ 👧 👵 ] - COCO is a large-scale object detection, segmentation, and captioning dataset.
  • HDM05 - HDM05 contains more than three hours of systematically recorded and well-documented motion capture data in the C3D as well as in the ASF/AMC data format.
  • KIT Whole-Body Human Motion Database
  • CGVU Interaction Database - This is the project page for creating a database of interactions between a character and an object/objects.

Description

  • Sensors and Data Types - 📷 (image), 🎥 (video), 🎤 (audio), 🤾‍♀️ (Motion Capture), ⌚️ (IMU or wearables), 🤹‍♀️ (Kinect or similar)
  • Sex - 👨‍🦰 (male), 👩 (female)
  • Age - 👧 (young), 👵 (eldery)

Data Processing

Recording

Data Conversion

  • video to bvh - Convert human motion from video to .bvh.
  • MotionCapturePy - Converts motion capture data from ASF and AMC files to Cartesian numpy arrays in python. Also plots a moving human frame using matplotlib.

Misc

Pose Estimation

Lectures

Papers

Implementations

  • 3Dpose_ssl - 3D Human Pose Machines with Self-supervised Learning.
  • 3dpose_gan - The authors' implementation of Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations.
  • 3d_pose_baseline_pytorch - A simple baseline for 3d human pose estimation in PyTorch.
  • 3d-pose-estimation - VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera.
  • 3D-HourGlass-Network - 3D HourGlass Networks for Human Pose Estimation Through Videos.
  • adversarially_parameterized_optimization - GAN-based 3D human pose estimation.
  • DensePose - A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body
  • VideoPose3D - Efficient 3D human pose estimation in video using 2D keypoint trajectorie.
  • 3d-pose-baseline - A simple baseline for 3d human pose estimation in tensorflow. Presented at ICCV 17.
  • Human Shape and Pose - End-to-end Recovery of Human Shape and Pose - CVPR 2018
  • AlphaPose - Real-Time and Accurate Multi-Person Pose Estimation&Tracking System.

Motion Analysis

Implementations

Motion Synthesis

Implementations

Researchers, Institutes, Projects

People

  • Daniel Holden - My name is Daniel Holden. I'm a programmer, writer, and digital artist currently working as a Machine Learning researcher at Ubisoft Montreal. My interests are Computer Graphics, Game Development, Theory of Computation, and Programming Languages.
  • Gustavo Boehs (3DeepLearner) - Deep Learning for Technical Artists in Animation, VFX, and Games.
  • Arash Hosseini - R&D Engineer and ML Enthusiast.
  • Sebastian Starke - Ph.D. student in Character Animation and Artificial Intelligence at the University of Edinburgh, School of Informatics, Institute of Perception, Action and Behaviour, supervised by Dr. Taku Komura.

Institutes and Projects

Commercial Projects

  • wrnch.ai - wrnch is a computer vision / deep learning software engineering company based in Montréal, Canada, a renowned hub for AI.
  • Qinematic - Qinematic has developed software for 3D markerless motion capture and human movement analysis since 2012.
  • DeepMotion - DeepMotion’s solutions bridge physical and digital motion for virtual characters and machines. Using physics simulation, computer vision, and machine learning, DeepMotion reconstructs realistic motion from real-world examples.

Journals

Journal Ranking

Conferences

  • ICRA - International Conference on Robotics and Automation
  • MICCAI - Medical Image Computing and Computer-Assisted Intervention
  • CVF - The Computer Vision Foundation

Conference Ranking

Videos

Two Minute Papers

CVPR 2019

Credits

This list benefits massively from the research work of Loreen Pogrzeba.

Contribute

Contributions welcome! Read the contribution guidelines first.

License

CC0

To the extent possible under law, derikon has waived all copyright and related or neighboring rights to this work.

Owner
Dennis Wittchen
Dennis Wittchen
Official PyTorch implementation of "IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in Videos", CVPRW 2021

IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in Videos Introduction This repo is official PyTorch implementatio

Gyeongsik Moon 29 Sep 24, 2022
Rotation Robust Descriptors

RoRD Rotation-Robust Descriptors and Orthographic Views for Local Feature Matching Project Page | Paper link Evaluation and Datasets MMA : Training on

Udit Singh Parihar 25 Nov 15, 2022
[ICCV 2021] Official Pytorch implementation for Discriminative Region-based Multi-Label Zero-Shot Learning SOTA results on NUS-WIDE and OpenImages

Discriminative Region-based Multi-Label Zero-Shot Learning (ICCV 2021) [arXiv][Project page coming soon] Sanath Narayan*, Akshita Gupta*, Salman Kh

Akshita Gupta 54 Nov 21, 2022
Implementation of the GBST block from the Charformer paper, in Pytorch

Charformer - Pytorch Implementation of the GBST (gradient-based subword tokenization) module from the Charformer paper, in Pytorch. The paper proposes

Phil Wang 105 Dec 26, 2022
classify fashion-mnist dataset with pytorch

Fashion-Mnist Classifier with PyTorch Inference 1- clone this repository: git clone https://github.com/Jhamed7/Fashion-Mnist-Classifier.git 2- Instal

1 Jan 14, 2022
Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval

BiDR Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval. Requirements torch==

Microsoft 11 Oct 20, 2022
World Models with TensorFlow 2

World Models This repo reproduces the original implementation of World Models. This implementation uses TensorFlow 2.2. Docker The easiest way to hand

Zac Wellmer 234 Nov 30, 2022
A benchmark framework for Tensorflow

TensorFlow benchmarks This repository contains various TensorFlow benchmarks. Currently, it consists of two projects: PerfZero: A benchmark framework

1.1k Dec 30, 2022
Implementation of "DeepOrder: Deep Learning for Test Case Prioritization in Continuous Integration Testing".

DeepOrder Implementation of DeepOrder for the paper "DeepOrder: Deep Learning for Test Case Prioritization in Continuous Integration Testing". Project

6 Nov 07, 2022
This repository contains small projects related to Neural Networks and Deep Learning in general.

ILearnDeepLearning.py Description People say that nothing develops and teaches you like getting your hands dirty. This repository contains small proje

Piotr Skalski 1.2k Dec 22, 2022
✅ How Robust are Fact Checking Systems on Colloquial Claims?. In NAACL-HLT, 2021.

How Robust are Fact Checking Systems on Colloquial Claims? Official PyTorch implementation of our NAACL paper: Byeongchang Kim*, Hyunwoo Kim*, Seokhee

Byeongchang Kim 19 Mar 15, 2022
Official PyTorch implementation of "AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks"

AASIST This repository provides the overall framework for training and evaluating audio anti-spoofing systems proposed in 'AASIST: Audio Anti-Spoofing

Clova AI Research 56 Jan 02, 2023
An efficient implementation of GPNN

Efficient-GPNN An efficient implementation of GPNN as depicted in "Drop the GAN: In Defense of Patches Nearest Neighbors as Single Image Generative Mo

7 Apr 16, 2022
Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering (NAACL 2021)

Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering Abstract In open-domain question answering (QA), retrieve-and-read mec

Clova AI Research 34 Apr 13, 2022
This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

CPM 项目描述 CPM(Chinese Pretrained Models)模型是北京智源人工智能研究院和清华大学发布的中文大规模预训练模型。官方发布了三种规模的模型,参数量分别为109M、334M、2.6B,用户需申请与通过审核,方可下载。 由于原项目需要考虑大模型的训练和使用,需要安装较为复杂

hzwer 190 Jan 08, 2023
Blind visual quality assessment on 360° Video based on progressive learning

Blind visual quality assessment on omnidirectional or 360 video (ProVQA) Blind VQA for 360° Video via Progressively Learning from Pixels, Frames and V

5 Jan 06, 2023
A PyTorch implementation of the continual learning experiments with deep neural networks

Brain-Inspired Replay A PyTorch implementation of the continual learning experiments with deep neural networks described in the following paper: Brain

182 Dec 27, 2022
My published benchmark for a Kaggle Simulations Competition

Lux AI Working Title Bot Please refer to the Kaggle notebook for the comment section. The comment section contains my explanation on my code structure

Tong Hui Kang 29 Aug 22, 2022
Implementation of Barlow Twins paper

barlowtwins PyTorch Implementation of Barlow Twins paper: Barlow Twins: Self-Supervised Learning via Redundancy Reduction This is currently a work in

IgorSusmelj 86 Dec 20, 2022
Open-source python package for the extraction of Radiomics features from 2D and 3D images and binary masks.

pyradiomics v3.0.1 Build Status Linux macOS Windows Radiomics feature extraction in Python This is an open-source python package for the extraction of

Artificial Intelligence in Medicine (AIM) Program 842 Dec 28, 2022