STAR

Official implementation of Sparse Transformer-based Action Recognition

Dataset

download NTU RGB+D 60 action recognition of 2D/3D skeleton from http://rose1.ntu.edu.sg/datasets/actionRecognition.asp

or use google drive

NTU60 NTU120

uzip data as the following file structure: $(project_folder)/raw/.\*skeleton or $(project_folder)/dataset/raw/.\*skeleton (create "raw" folder under $(project_folder) or $(project_folder)/dataset then put raw skeleton files under "raw" folder)

run the code below to generate dataset:

python datagen.py

Training

git fetch and checkout to "distributed" branch

python train_dist.py -#distributed training

Configuration

parser.set_defaults(gpu=True,
                    batch_size=128,
                    dataset_name='NTU',
                    dataset_root=osp.join(os.getcwd()),  # or dataset_root=osp.join(os.getcwd(), 'dataset')
                    load_model=False,
                    in_channels=9,
                    num_enc_layers=5,
                    num_conv_layers=2,
                    weight_decay=4e-5,
                    drop_rate=[0.4, 0.4, 0.4, 0.4],  # linear_attention, sparse_attention, add_norm, ffn
                    hid_channels=64,
                    out_channels=64,
                    heads=8,
                    data_parallel=False,
                    cross_k=5,
                    mlp_head_hidden=128)

parser.set_defaults(gpu=True,
                    batch_size=128,
                    dataset_name='NTU',
                    dataset_root=osp.join(os.getcwd()),
                    load_model=False,
                    in_channels=9,
                    num_enc_layers=5,
                    num_conv_layers=2,
                    weight_decay=4e-5,
                    drop_rate=[0.4, 0.4, 0.4, 0.4],  # linear_attention, sparse_attention, add_norm, ffn
                    hid_channels=128,
                    out_channels=128,
                    heads=8,
                    data_parallel=False,
                    cross_k=5,
                    mlp_head_hidden=128)

Official implementation of Sparse Transformer-based Action Recognition

Related tags

Overview

STAR

Dataset

Training

Configuration

Owner

Chonghan_Lee

The implementation of "Bootstrapping Semantic Segmentation with Regional Contrast".

✂️ EyeLipCropper is a Python tool to crop eyes and mouth ROIs of the given video.

Automatic Attendance marker for LMS Practice School Division, BITS Pilani

PyElastica is the Python implementation of Elastica, an open-source software for the simulation of assemblies of slender, one-dimensional structures using Cosserat Rod theory.

[ICCV 2021 Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

Official implementation of the method ContIG, for self-supervised learning from medical imaging with genomics

Pyramid Grafting Network for One-Stage High Resolution Saliency Detection. CVPR 2022

Torch code for our CVPR 2018 paper "Residual Dense Network for Image Super-Resolution" (Spotlight)

Pytorch implementation of paper: "NeurMiPs: Neural Mixture of Planar Experts for View Synthesis"

git《USD-Seg:Learning Universal Shape Dictionary for Realtime Instance Segmentation》(2020) GitHub: [fig2]

BC3407-Group-5-Project - BC3407 Group Project With Python

A python-image-classification web application project, written in Python and served through the Flask Microframework

This repository contains the code for the CVPR 2020 paper "Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision"

This repository provides the official code for GeNER (an automated dataset Generation framework for NER).

Convnet transfer - Code for paper How transferable are features in deep neural networks?

An implementation of Video Frame Interpolation via Adaptive Separable Convolution using PyTorch

Self-Supervised Monocular DepthEstimation with Internal Feature Fusion(arXiv), BMVC2021

El-Gamal on Elliptic Curve (Python)

DANet for Tabular data classification/ regression.

(ICONIP 2020) MobileHand: Real-time 3D Hand Shape and Pose Estimation from Color Image