Human-Pose-and-Motion History

Overview

Human Pose and Motion

Scientist Approach

Eadweard Muybridge, The Galloping Horse Portfolio, 1887

Eadweard Muybridge, The Galloping Horse Portfolio, 1887

Etienne-Jules Marey, Descent of Inclined Plane,

Chronophotograph, 1882

Etienne-Jules Marey, Descent of Inclined Plane, c. 1882, Chronophotograph

E.J. Marey, Geometric Chronophotograph of the man in the black suit, 1883

E.J. Marey, Geometric Chronophotograph of the man in the black suit, 1883

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/ejm_chronophotograph01.jpg

Man in the black suit with striping and points for chronophotography, 1883

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/MAREY_SUIT_1.GIF

Etienne-Jules Marey and George Demeny “Pathological walk from in front”(1889) (the first light painting photograph)

Etienne-Jules Marey and George Demeny “Pathological walk from in front”(1889)

https://upload.wikimedia.org/wikipedia/commons/b/b5/Etienne-Jules_Marey_et_George_Demeny._Pathological_Walk_from_the_Front.jpg

E.J. Marey, Chronophotographs from "The Human Body in Action," Scientific American, 1914

E.J. Marey, Chronophotographs from "The Human Body in Action," Scientific American, 1914

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/ejm04.jpg

Stroboscope(WIP)

Artist and Choreographer’s approach

Rudolph Von Laban (1879-1958)

the first choreographer to define a movement vocabulary in the body’s relationship to “space,” “shape,” and “effort(the inner impulses)” (Hutchinson, 7).

Rudolph Von Laban “Kinesphere”

Rudolf Laban” Documentary Raitre”

https://www.youtube.com/watch?v=iQUq94KJDYM&

https://youtu.be/iQUq94KJDYM

Oscar Schlemmer “man with slanting bars” (1930)

man with slanting bars [Schlemmer, 1930]

https://www.dropbox.com/s/w22pwozy4eva1hh/Screenshot%202018-05-16%2016.50.37.png?dl=0

https://www.dropbox.com/s/1dvvt6aevmf9n5t/Screenshot%202018-05-16%2016.51.17.png?dl=0

Drawing

Giacomo Balla

Dynamism of a Dog on a Leash (1912)

Balla, Giacomo, Dynamism of a Dog on a Leash (1912)  Oil on canvas, 89.8x109.8cm,  Buffalo: Albright-Knox Art Gallery

Marcel Duchamp, Nude Descending a Staircase, No. 2, 1912

Marcel Duchamp, Nude Descending a Staircase, No. 2, 1912

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/duchampdescending.jpg

Alberto Giacometti, Femme Qui Marche, 1955

Alberto Giacometti, Femme Qui Marche, 1955, 20.4 x 6.2 cm

Film

Norman Mclaren Pas de Deux(1960)

https://www.youtube.com/watch?v=H-uwuH_Qix4&

https://youtu.be/H-uwuH_Qix4

more artists , photographer (1930~

Harold Edgerton, Frank and Lillian Gilbreth, Gjon Mili

[ ] TODO: add more embed pictures

Man Ray“Space Writing”(1935)

https://research.bowdoin.edu/surrealist-photography/files/2014/02/1987.15.jpg

Dr. Harold E. Edgerton “Golfer” 1937 https://www.moma.org/collection/works/44219

Dr. Harold E. Edgerton “Bobby Jones, high-speed photography, golfing” - 1938 (?) http://webmuseum.mit.edu/images/DIAmed/HEE-NC-38024.L.jpg

Gjion MiliPablo Picasso "draws" a centaur in the air with light, 1949.

Pablo Picasso "draws" a centaur in the air with light, 1949. Gjon Mili—The LIFE Picture Collection/Getty Images

https://timedotcom.files.wordpress.com/2012/01/150316-pablo-picasso-01.jpg?quality=85&w=861

Eliot Eliofson, Duchamp descending a staircase, photograph from Life Magazine (1952)

Eliot Eliofson, Duchamp descending a staircase, photograph from Life Magazine (1952)

Engineer / Digital Media Artist’s approach

Openendedgroup + Merce Cunningham “Biped” (1999)

http://openendedgroup.com/artworks/biped.html

ISSEY MIYAKE A-POC INSIDE(2006) animation by Euphrates

https://www.youtube.com/watch?v=aYL4TyV1YDk&

http://euphrates.jp/ISSEY-MIYAKE-A-POC-INSIDE

SATO Tetsuji + SAKAMOTO Yoichi “blank” May 16, 2009 - August 9, 2009

https://player.vimeo.com/video/274663590

https://vimeo.com/274663590 http://www.ntticc.or.jp/en/exhibitions/2009/emergencies-011-sato-tetsuji-sakamoto-yoichi/

EUPHRATES “ballet rotoscope”(2011)

https://www.youtube.com/watch?v=yzJk6ww3LD0&&t=8s

http://euphrates.jp/ballet-rotoscope

UniversalEverything “Walking City” (2014)

https://player.vimeo.com/video/85596568

https://vimeo.com/85596568

Study for Fifteen Points / I by Random International (2016)

https://player.vimeo.com/video/162979922

https://vimeo.com/162979922 https://www.random-international.com/study-for-fifteen-points-2015

Golan Levin “Ghost Pole Propagator II” (2007, 2016) http://www.flong.com/projects/gpp-ii/

https://player.vimeo.com/video/219150989

https://vimeo.com/219150989

Machine Learning

Human Motion generation, synthesis

Dynamic Response for Motion Capture Animation(2008)

https://www.youtube.com/watch?v=JzAEx6d4ow4&

https://youtu.be/JzAEx6d4ow4

Human Motion Synthesis with Optimization-Based Graphs(2011)

https://www.youtube.com/watch?v=mInQEn0UxB0&

https://youtu.be/mInQEn0UxB0

A Deep Learning Framework for Character Motion Synthesis and Editing (SIGGRAPH 2016)

https://www.youtube.com/watch?v=urf-AAIwNYk&

https://youtu.be/urf-AAIwNYk

https://www.youtube.com/watch?v=W1oRgDPxEkc&

https://youtu.be/W1oRgDPxEkc

https://www.youtube.com/watch?v=c9h9zc7uPWQ&

https://youtu.be/c9h9zc7uPWQ

Computational Foresight: Realtime Forecast of Human Body Motion(2017)

https://www.youtube.com/watch?v=TXbhXgTMtNU&

https://youtu.be/TXbhXgTMtNU Phase-Functioned Neural Networks for Character Control(2017)

https://www.youtube.com/watch?v=Ul0Gilv5wvY&&t=57s

https://youtu.be/Ul0Gilv5wvY?t=57s

SIIGGRAPH 2018 Deep Mimic paper(main video)

https://www.youtube.com/watch?v=vppFvq2quQ0&&t=6s

https://youtu.be/vppFvq2quQ0?t=6s

Motion Capture / Pose Estimation Technic

openpose https://github.com/CMU-Perceptual-Computing-Lab/openpose

https://www.youtube.com/watch?v=C1Sxk6zxWLM&

https://youtu.be/C1Sxk6zxWLM

densepose http://densepose.org

https://www.youtube.com/watch?v=Dhkd_bAwwMc&

https://youtu.be/Dhkd_bAwwMc

PoseNet

Real-time Human Pose Estimation in the Browser with TensorFlow.js https://medium.com/tensorflow/real-time-human-pose-estimation-in-the-browser-with-tensorflow-js-7dd0bc881cd5

https://cdn-images-1.medium.com/max/1200/1*Gsx7MLBj2LKiaDsab0iNjg.gif

PoseNet https://github.com/tensorflow/tfjs-models/tree/master/posenet

Live Demo https://storage.googleapis.com/tfjs-models/demos/posenet/camera.html

RADiCAL

AI-powered 3D motion capture, minus the suits and hardware. https://getrad.co/#register

https://www.dropbox.com/s/bitz8pdrn5pxf71/Screenshot%202018-05-16%2017.29.42.png?dl=0

MonoPerfCap: Human Performance Capture from Monocular Video

http://gvv.mpi-inf.mpg.de/projects/wxu/MonoPerfCap/ https://arxiv.org/abs/1708.02136

https://www.dropbox.com/s/bsu60ot8tmhh79q/Screenshot%202018-05-16%2017.29.20.png?dl=0

Military

https://www.youtube.com/watch?v=D7I4qf-HlEI&

https://youtu.be/D7I4qf-HlEI

https://www.youtube.com/watch?v=zYypJPJipYc&

https://youtu.be/zYypJPJipYc

Soccer On Your Tabletop http://grail.cs.washington.edu/projects/soccer/

https://www.youtube.com/watch?v=eRGAB4QBS6U&

https://youtu.be/eRGAB4QBS6U

Bibiography

Golan Levin Audiovisual Software Art: A Partial History,9 May 2009

http://www.flong.com/texts/essays/see_this_sound_old/#case2

THE SPACE OF THE FALL, On Dance, Architecture, Bodily Perspective and Gravity

http://home.hccnet.nl/j.w.nijenhuis/artikel/TheSpaceoftheFallonDancea.html

Etienne-Jules Marey archive http://www.expo-marey.com/ANGLAIS/home.html

Eadweard Muybridge Works Online** http://www.artcyclopedia.com/artists/muybridge_eadweard.html

UCBerkeley “ HUMAN FACTORS AND EXISTENTIAL PHENOMENOLOGY”

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/images.html

MOMA Collection

https://www.moma.org/collection/works/49635?artist_id=1681

human-pose-detection by samim

https://medium.com/@samim/human-pose-detection-51268e95ddc2

light-painting-history

http://lightpaintingphotography.com/light-painting-history/

edgerton digital collections

https://edgerton-digital-collections.org

ラバン身体動作表現理論について

https://staff.aist.go.jp/toru-nakata/shintairon.html

a brief history of motion capture in the movies

http://www.ign.com/articles/2014/07/11/a-brief-history-of-motion-capture-in-the-movies

https://twitter.com/kcimc/status/1004428337597505536

https://twitter.com/kcimc/status/1004428337597505536

https://twitter.com/kcimc/status/1004427682883366912

https://twitter.com/kcimc/status/1004427682883366912

Owner
Daito Manabe
old school youtuber
Daito Manabe
The code for the CVPR 2021 paper Neural Deformation Graphs, a novel approach for globally-consistent deformation tracking and 3D reconstruction of non-rigid objects.

Neural Deformation Graphs Project Page | Paper | Video Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction Aljaž Božič, Pablo P

Aljaz Bozic 134 Dec 16, 2022
Code for "Retrieving Black-box Optimal Images from External Databases" (WSDM 2022)

Retrieving Black-box Optimal Images from External Databases (WSDM 2022) We propose how a user retreives an optimal image from external databases of we

joisino 5 Apr 13, 2022
a basic code repository for basic task in CV(classification,detection,segmentation)

basic_cv a basic code repository for basic task in CV(classification,detection,segmentation,tracking) classification generate dataset train predict de

1 Oct 15, 2021
Find the Heart simple Python Game

This is a simple Python game for finding a heart emoji. There is a 3 x 3 matrix in which a heart emoji resides. The location of the heart is randomized and is not revealed. The player must guess the

p.katekomol 1 Jan 24, 2022
GT China coal model

GT China coal model The full version of a China coal transport model with a very high spatial reslution. What it does The code works in a few steps: T

0 Dec 13, 2021
Convert openmmlab (not only mmdetection) series model to tensorrt

MMDet to TensorRT This project aims to convert the mmdetection model to TensorRT model end2end. Focus on object detection for now. Mask support is exp

JinTian 4 Dec 17, 2021
PointPillars inference with TensorRT

A project demonstrating how to use CUDA-PointPillars to deal with cloud points data from lidar.

NVIDIA AI IOT 315 Dec 31, 2022
Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions

torch-imle Concise and self-contained PyTorch library implementing the I-MLE gradient estimator proposed in our NeurIPS 2021 paper Implicit MLE: Backp

UCL Natural Language Processing 249 Jan 03, 2023
PyTorch implementation of Glow

glow-pytorch PyTorch implementation of Glow, Generative Flow with Invertible 1x1 Convolutions (https://arxiv.org/abs/1807.03039) Usage: python train.p

Kim Seonghyeon 433 Dec 27, 2022
Selfplay In MultiPlayer Environments

This project allows you to train AI agents on custom-built multiplayer environments, through self-play reinforcement learning.

200 Jan 08, 2023
Code repository for the paper "Doubly-Trained Adversarial Data Augmentation for Neural Machine Translation" with instructions to reproduce the results.

Doubly Trained Neural Machine Translation System for Adversarial Attack and Data Augmentation Languages Experimented: Data Overview: Source Target Tra

Steven Tan 1 Aug 18, 2022
PyTorch code of paper "LiVLR: A Lightweight Visual-Linguistic Reasoning Framework for Video Question Answering"

LiVLR-VideoQA We propose a Lightweight Visual-Linguistic Reasoning framework (LiVLR) for VideoQA. The overview of LiVLR: Evaluation on MSRVTT-QA Datas

JJ Jiang 7 Dec 30, 2022
Fast and scalable uncertainty quantification for neural molecular property prediction, accelerated optimization, and guided virtual screening.

Evidential Deep Learning for Guided Molecular Property Prediction and Discovery Ava Soleimany*, Alexander Amini*, Samuel Goldman*, Daniela Rus, Sangee

Alexander Amini 75 Dec 15, 2022
A curated list of automated deep learning (including neural architecture search and hyper-parameter optimization) resources.

Awesome AutoDL A curated list of automated deep learning related resources. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awe

D-X-Y 2k Dec 30, 2022
Code for our paper "Graph Pre-training for AMR Parsing and Generation" in ACL2022

AMRBART An implementation for ACL2022 paper "Graph Pre-training for AMR Parsing and Generation". You may find our paper here (Arxiv). Requirements pyt

xfbai 60 Jan 03, 2023
Automatically measure the facial Width-To-Height ratio and get facial analysis results provided by Microsoft Azure

fwhr-calc-website This project is to automatically measure the facial Width-To-Height ratio and get facial analysis results provided by Microsoft Azur

SoohyunPark 1 Feb 07, 2022
Pytorch implementation of Generative Models as Distributions of Functions 🌿

Generative Models as Distributions of Functions This repo contains code to reproduce all experiments in Generative Models as Distributions of Function

Emilien Dupont 117 Dec 29, 2022
A comprehensive list of published machine learning applications to cosmology

ml-in-cosmology This github attempts to maintain a comprehensive list of published machine learning applications to cosmology, organized by subject ma

George Stein 290 Dec 29, 2022
[CVPR2021] UAV-Human: A Large Benchmark for Human Behavior Understanding with Unmanned Aerial Vehicles

UAV-Human Official repository for CVPR2021: UAV-Human: A Large Benchmark for Human Behavior Understanding with Unmanned Aerial Vehicle Paper arXiv Res

129 Jan 04, 2023
A simple Tensorflow based library for deep and/or denoising AutoEncoder.

libsdae - deep-Autoencoder & denoising autoencoder A simple Tensorflow based library for Deep autoencoder and denoising AE. Library follows sklearn st

Rajarshee Mitra 147 Nov 18, 2022