Human-Pose-and-Motion History

Overview

Human Pose and Motion

Scientist Approach

Eadweard Muybridge, The Galloping Horse Portfolio, 1887

Eadweard Muybridge, The Galloping Horse Portfolio, 1887

Etienne-Jules Marey, Descent of Inclined Plane,

Chronophotograph, 1882

Etienne-Jules Marey, Descent of Inclined Plane, c. 1882, Chronophotograph

E.J. Marey, Geometric Chronophotograph of the man in the black suit, 1883

E.J. Marey, Geometric Chronophotograph of the man in the black suit, 1883

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/ejm_chronophotograph01.jpg

Man in the black suit with striping and points for chronophotography, 1883

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/MAREY_SUIT_1.GIF

Etienne-Jules Marey and George Demeny “Pathological walk from in front”(1889) (the first light painting photograph)

Etienne-Jules Marey and George Demeny “Pathological walk from in front”(1889)

https://upload.wikimedia.org/wikipedia/commons/b/b5/Etienne-Jules_Marey_et_George_Demeny._Pathological_Walk_from_the_Front.jpg

E.J. Marey, Chronophotographs from "The Human Body in Action," Scientific American, 1914

E.J. Marey, Chronophotographs from "The Human Body in Action," Scientific American, 1914

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/ejm04.jpg

Stroboscope(WIP)

Artist and Choreographer’s approach

Rudolph Von Laban (1879-1958)

the first choreographer to define a movement vocabulary in the body’s relationship to “space,” “shape,” and “effort(the inner impulses)” (Hutchinson, 7).

Rudolph Von Laban “Kinesphere”

Rudolf Laban” Documentary Raitre”

https://www.youtube.com/watch?v=iQUq94KJDYM&

https://youtu.be/iQUq94KJDYM

Oscar Schlemmer “man with slanting bars” (1930)

man with slanting bars [Schlemmer, 1930]

https://www.dropbox.com/s/w22pwozy4eva1hh/Screenshot%202018-05-16%2016.50.37.png?dl=0

https://www.dropbox.com/s/1dvvt6aevmf9n5t/Screenshot%202018-05-16%2016.51.17.png?dl=0

Drawing

Giacomo Balla

Dynamism of a Dog on a Leash (1912)

Balla, Giacomo, Dynamism of a Dog on a Leash (1912)  Oil on canvas, 89.8x109.8cm,  Buffalo: Albright-Knox Art Gallery

Marcel Duchamp, Nude Descending a Staircase, No. 2, 1912

Marcel Duchamp, Nude Descending a Staircase, No. 2, 1912

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/duchampdescending.jpg

Alberto Giacometti, Femme Qui Marche, 1955

Alberto Giacometti, Femme Qui Marche, 1955, 20.4 x 6.2 cm

Film

Norman Mclaren Pas de Deux(1960)

https://www.youtube.com/watch?v=H-uwuH_Qix4&

https://youtu.be/H-uwuH_Qix4

more artists , photographer (1930~

Harold Edgerton, Frank and Lillian Gilbreth, Gjon Mili

[ ] TODO: add more embed pictures

Man Ray“Space Writing”(1935)

https://research.bowdoin.edu/surrealist-photography/files/2014/02/1987.15.jpg

Dr. Harold E. Edgerton “Golfer” 1937 https://www.moma.org/collection/works/44219

Dr. Harold E. Edgerton “Bobby Jones, high-speed photography, golfing” - 1938 (?) http://webmuseum.mit.edu/images/DIAmed/HEE-NC-38024.L.jpg

Gjion MiliPablo Picasso "draws" a centaur in the air with light, 1949.

Pablo Picasso "draws" a centaur in the air with light, 1949. Gjon Mili—The LIFE Picture Collection/Getty Images

https://timedotcom.files.wordpress.com/2012/01/150316-pablo-picasso-01.jpg?quality=85&w=861

Eliot Eliofson, Duchamp descending a staircase, photograph from Life Magazine (1952)

Eliot Eliofson, Duchamp descending a staircase, photograph from Life Magazine (1952)

Engineer / Digital Media Artist’s approach

Openendedgroup + Merce Cunningham “Biped” (1999)

http://openendedgroup.com/artworks/biped.html

ISSEY MIYAKE A-POC INSIDE(2006) animation by Euphrates

https://www.youtube.com/watch?v=aYL4TyV1YDk&

http://euphrates.jp/ISSEY-MIYAKE-A-POC-INSIDE

SATO Tetsuji + SAKAMOTO Yoichi “blank” May 16, 2009 - August 9, 2009

https://player.vimeo.com/video/274663590

https://vimeo.com/274663590 http://www.ntticc.or.jp/en/exhibitions/2009/emergencies-011-sato-tetsuji-sakamoto-yoichi/

EUPHRATES “ballet rotoscope”(2011)

https://www.youtube.com/watch?v=yzJk6ww3LD0&&t=8s

http://euphrates.jp/ballet-rotoscope

UniversalEverything “Walking City” (2014)

https://player.vimeo.com/video/85596568

https://vimeo.com/85596568

Study for Fifteen Points / I by Random International (2016)

https://player.vimeo.com/video/162979922

https://vimeo.com/162979922 https://www.random-international.com/study-for-fifteen-points-2015

Golan Levin “Ghost Pole Propagator II” (2007, 2016) http://www.flong.com/projects/gpp-ii/

https://player.vimeo.com/video/219150989

https://vimeo.com/219150989

Machine Learning

Human Motion generation, synthesis

Dynamic Response for Motion Capture Animation(2008)

https://www.youtube.com/watch?v=JzAEx6d4ow4&

https://youtu.be/JzAEx6d4ow4

Human Motion Synthesis with Optimization-Based Graphs(2011)

https://www.youtube.com/watch?v=mInQEn0UxB0&

https://youtu.be/mInQEn0UxB0

A Deep Learning Framework for Character Motion Synthesis and Editing (SIGGRAPH 2016)

https://www.youtube.com/watch?v=urf-AAIwNYk&

https://youtu.be/urf-AAIwNYk

https://www.youtube.com/watch?v=W1oRgDPxEkc&

https://youtu.be/W1oRgDPxEkc

https://www.youtube.com/watch?v=c9h9zc7uPWQ&

https://youtu.be/c9h9zc7uPWQ

Computational Foresight: Realtime Forecast of Human Body Motion(2017)

https://www.youtube.com/watch?v=TXbhXgTMtNU&

https://youtu.be/TXbhXgTMtNU Phase-Functioned Neural Networks for Character Control(2017)

https://www.youtube.com/watch?v=Ul0Gilv5wvY&&t=57s

https://youtu.be/Ul0Gilv5wvY?t=57s

SIIGGRAPH 2018 Deep Mimic paper(main video)

https://www.youtube.com/watch?v=vppFvq2quQ0&&t=6s

https://youtu.be/vppFvq2quQ0?t=6s

Motion Capture / Pose Estimation Technic

openpose https://github.com/CMU-Perceptual-Computing-Lab/openpose

https://www.youtube.com/watch?v=C1Sxk6zxWLM&

https://youtu.be/C1Sxk6zxWLM

densepose http://densepose.org

https://www.youtube.com/watch?v=Dhkd_bAwwMc&

https://youtu.be/Dhkd_bAwwMc

PoseNet

Real-time Human Pose Estimation in the Browser with TensorFlow.js https://medium.com/tensorflow/real-time-human-pose-estimation-in-the-browser-with-tensorflow-js-7dd0bc881cd5

https://cdn-images-1.medium.com/max/1200/1*Gsx7MLBj2LKiaDsab0iNjg.gif

PoseNet https://github.com/tensorflow/tfjs-models/tree/master/posenet

Live Demo https://storage.googleapis.com/tfjs-models/demos/posenet/camera.html

RADiCAL

AI-powered 3D motion capture, minus the suits and hardware. https://getrad.co/#register

https://www.dropbox.com/s/bitz8pdrn5pxf71/Screenshot%202018-05-16%2017.29.42.png?dl=0

MonoPerfCap: Human Performance Capture from Monocular Video

http://gvv.mpi-inf.mpg.de/projects/wxu/MonoPerfCap/ https://arxiv.org/abs/1708.02136

https://www.dropbox.com/s/bsu60ot8tmhh79q/Screenshot%202018-05-16%2017.29.20.png?dl=0

Military

https://www.youtube.com/watch?v=D7I4qf-HlEI&

https://youtu.be/D7I4qf-HlEI

https://www.youtube.com/watch?v=zYypJPJipYc&

https://youtu.be/zYypJPJipYc

Soccer On Your Tabletop http://grail.cs.washington.edu/projects/soccer/

https://www.youtube.com/watch?v=eRGAB4QBS6U&

https://youtu.be/eRGAB4QBS6U

Bibiography

Golan Levin Audiovisual Software Art: A Partial History,9 May 2009

http://www.flong.com/texts/essays/see_this_sound_old/#case2

THE SPACE OF THE FALL, On Dance, Architecture, Bodily Perspective and Gravity

http://home.hccnet.nl/j.w.nijenhuis/artikel/TheSpaceoftheFallonDancea.html

Etienne-Jules Marey archive http://www.expo-marey.com/ANGLAIS/home.html

Eadweard Muybridge Works Online** http://www.artcyclopedia.com/artists/muybridge_eadweard.html

UCBerkeley “ HUMAN FACTORS AND EXISTENTIAL PHENOMENOLOGY”

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/images.html

MOMA Collection

https://www.moma.org/collection/works/49635?artist_id=1681

human-pose-detection by samim

https://medium.com/@samim/human-pose-detection-51268e95ddc2

light-painting-history

http://lightpaintingphotography.com/light-painting-history/

edgerton digital collections

https://edgerton-digital-collections.org

ラバン身体動作表現理論について

https://staff.aist.go.jp/toru-nakata/shintairon.html

a brief history of motion capture in the movies

http://www.ign.com/articles/2014/07/11/a-brief-history-of-motion-capture-in-the-movies

https://twitter.com/kcimc/status/1004428337597505536

https://twitter.com/kcimc/status/1004428337597505536

https://twitter.com/kcimc/status/1004427682883366912

https://twitter.com/kcimc/status/1004427682883366912

Owner
Daito Manabe
old school youtuber
Daito Manabe
Official implementation of "Implicit Neural Representations with Periodic Activation Functions"

Implicit Neural Representations with Periodic Activation Functions Project Page | Paper | Data Vincent Sitzmann*, Julien N. P. Martel*, Alexander W. B

Vincent Sitzmann 1.4k Jan 06, 2023
CAST: Character labeling in Animation using Self-supervision by Tracking

CAST: Character labeling in Animation using Self-supervision by Tracking (Published as a conference paper at EuroGraphics 2022) Note: The CAST paper c

15 Nov 18, 2022
Companion repo of the UCC 2021 paper "Predictive Auto-scaling with OpenStack Monasca"

Predictive Auto-scaling with OpenStack Monasca Giacomo Lanciano*, Filippo Galli, Tommaso Cucinotta, Davide Bacciu, Andrea Passarella 2021 IEEE/ACM 14t

Giacomo Lanciano 0 Dec 07, 2022
Automatically creates genre collections for your Plex media

Plex Auto Genres Plex Auto Genres is a simple script that will add genre collection tags to your media making it much easier to search for genre speci

Shane Israel 63 Dec 31, 2022
Learning Chinese Character style with conditional GAN

zi2zi: Master Chinese Calligraphy with Conditional Adversarial Networks Introduction Learning eastern asian language typefaces with GAN. zi2zi(字到字, me

Yuchen Tian 2.2k Jan 02, 2023
A high-performance distributed deep learning system targeting large-scale and automated distributed training.

HETU Documentation | Examples Hetu is a high-performance distributed deep learning system targeting trillions of parameters DL model training, develop

DAIR Lab 150 Dec 21, 2022
🌈 PyTorch Implementation for EMNLP'21 Findings "Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer"

SGLKT-VisDial Pytorch Implementation for the paper: Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer Gi-Cheon Kang, Junseok P

Gi-Cheon Kang 9 Jul 05, 2022
A library for building and serving multi-node distributed faiss indices.

About Distributed faiss index service. A lightweight library that lets you work with FAISS indexes which don't fit into a single server memory. It fol

Meta Research 170 Dec 30, 2022
This is the official PyTorch implementation of our paper: "Artistic Style Transfer with Internal-external Learning and Contrastive Learning".

Artistic Style Transfer with Internal-external Learning and Contrastive Learning This is the official PyTorch implementation of our paper: "Artistic S

51 Dec 20, 2022
Inflated i3d network with inception backbone, weights transfered from tensorflow

I3D models transfered from Tensorflow to PyTorch This repo contains several scripts that allow to transfer the weights from the tensorflow implementat

Yana 479 Dec 08, 2022
Reproduces ResNet-V3 with pytorch

ResNeXt.pytorch Reproduces ResNet-V3 (Aggregated Residual Transformations for Deep Neural Networks) with pytorch. Tried on pytorch 1.6 Trains on Cifar

Pau Rodriguez 481 Dec 23, 2022
[UNMAINTAINED] Automated machine learning for analytics & production

auto_ml Automated machine learning for production and analytics Installation pip install auto_ml Getting started from auto_ml import Predictor from au

Preston Parry 1.6k Jan 02, 2023
PyTorchMemTracer - Depict GPU memory footprint during DNN training of PyTorch

A Memory Tracer For PyTorch OOM is a nightmare for PyTorch users. However, most

Jiarui Fang 9 Nov 14, 2022
ICSS - Interactive Continual Semantic Segmentation

Presentation This repository contains the code of our paper: Weakly-supervised c

Alteia 9 Jul 23, 2022
ConvMAE: Masked Convolution Meets Masked Autoencoders

ConvMAE ConvMAE: Masked Convolution Meets Masked Autoencoders Peng Gao1, Teli Ma1, Hongsheng Li2, Jifeng Dai3, Yu Qiao1, 1 Shanghai AI Laboratory, 2 M

Alpha VL Team of Shanghai AI Lab 345 Jan 08, 2023
Code for testing convergence rates of Lipschitz learning on graphs

📈 LipschitzLearningRates The code in this repository reproduces the experimental results on convergence rates for k-nearest neighbor graph infinity L

2 Dec 20, 2021
《Rethinking Sptil Dimensions of Vision Trnsformers》(2021)

Rethinking Spatial Dimensions of Vision Transformers Byeongho Heo, Sangdoo Yun, Dongyoon Han, Sanghyuk Chun, Junsuk Choe, Seong Joon Oh | Paper NAVER

NAVER AI 224 Dec 27, 2022
Generates all variables from your .tf files into a variables.tf file.

tfvg Generates all variables from your .tf files into a variables.tf file. It searches for every var.variable_name in your .tf files and generates a v

1 Dec 01, 2022
Rust bindings for the C++ api of PyTorch.

tch-rs Rust bindings for the C++ api of PyTorch. The goal of the tch crate is to provide some thin wrappers around the C++ PyTorch api (a.k.a. libtorc

Laurent Mazare 2.3k Dec 30, 2022
Official source code to CVPR'20 paper, "When2com: Multi-Agent Perception via Communication Graph Grouping"

When2com: Multi-Agent Perception via Communication Graph Grouping This is the PyTorch implementation of our paper: When2com: Multi-Agent Perception vi

34 Nov 09, 2022