Immortal tracker

Last update: Dec 03, 2022

Related tags

Overview

Immortal_tracker

Prerequisite

Our code is tested for Python 3.6.
To install required liabraries:

pip install -r requirements.txt

Waymo Open Dataset

Prepare dataset & off-the-shelf detections

Download WOD perception dataset:

#Waymo Dataset         
└── waymo
       ├── training (not required)  
       ├── validation   
       ├── testing

To extract timestamp infos/ego infos from .tfrecord files, run the following:

bash preparedata/waymo/waymo_preparedata.sh  /
   
    /waymo

Run the following to convert detection results into to .npz files. The detection results should be in official WOD submission format(.bin)
We recommand you to use CenterPoint(two-frame model for tracking) detection results for reproducing our results. Please follow https://github.com/tianweiy/CenterPoint or email its author for CenterPoint detection results.

bash preparedata/waymo/waymo_convert_detection.sh 
   
    /detection_result.bin cp

#you can also use other detections:
#bash preparedata/waymo/waymo_convert_detection.sh

Inference

Use the following command to start inferencing on WOD. The validation set is used by default.

python main_waymo.py --name immortal --det_name cp --config_path configs/waymo_configs/immortal.yaml --process 8

Evaluation with WOD official devkit:

Follow https://github.com/waymo-research/waymo-open-dataset to build the evaluation tools and run the following command for evaluation:

#Convert the tracking results into .bin file
python evaluation/waymo/pred_bin.py --name immortal
#For evaluation

   
    /bazel-bin/waymo_open_dataset/metrics/tools/compute_tracking_metrics_main mot_results/waymo/validation/immortal/bin/pred.bin 
    
     /validation_gt.bin

nuScenes Dataset

Prepare dataset & off-the-shelf detections

Download nuScenes perception dataset

# For nuScenes Dataset         
└── NUSCENES_DATASET_ROOT
       ├── samples       
       ├── sweeps       
       ├── maps         
       ├── v1.0-trainval 
       ├── v1.0-test

To extract timestamp infos/ego infos, run the following:

bash preparedata/nuscenes/nu_preparedata.sh 
   
    /nuscenes

Run the following to convert detection results into to .npz files. The detection results should be in official nuScenes submission format(.json)
We recommand you to use centerpoint(two-frame model for tracking) detection results for reproducing our results.

bash preparedata/nuscenes/nu_convert_detection.sh  
   
    /detection_result.json cp

#you can also use other detections:
#bash preparedata/nuscenes/nu_convert_detection.sh

Inference

Use the following command to start inferencing on nuScenes. The validation set is used by default.

python main_nuscenes.py --name immortal --det_name cp --config_path configs/nu_configs/immortal.yaml --process 8

Evaluation with nuScenes official devkit:

Follow https://github.com/nutonomy/nuscenes-devkit to build the official evaluation tools for nuScenes. Run the following command for evaluation:

/nuscenes ">

#To convert tracking results into .json format
bash evaluation/nuscenes/pipeline.sh immortal
#To evaluate
python 
   
    /nuscenes-devkit/python-sdk/nuscenes/eval/tracking/evaluate.py \
"./mot_results/nuscenes/validation_2hz/immortal/results/results.json" \
--output_dir "./mot_results/nuscenes/validation_2hz/immortal/results" \
--eval_set "val" \
--dataroot 
    
     /nuscenes

Immortal tracker

Related tags

Overview

Immortal_tracker

Prerequisite

Waymo Open Dataset

Prepare dataset & off-the-shelf detections

Download WOD perception dataset:

Inference

Evaluation with WOD official devkit:

nuScenes Dataset

Prepare dataset & off-the-shelf detections

Download nuScenes perception dataset

Inference

Evaluation with nuScenes official devkit:

Owner

A curated list of awesome Deep Learning tutorials, projects and communities.

A torch implementation of "Pixel-Level Domain Transfer"

LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT

RuDOLPH: One Hyper-Modal Transformer can be creative as DALL-E and smart as CLIP

Deep Learning and Reinforcement Learning Library for Scientists and Engineers 🔥

Dataset and Code for the paper "DepthTrack: Unveiling the Power of RGBD Tracking" (ICCV2021), and "Depth-only Object Tracking" (BMVC2021)

On-device speech-to-index engine powered by deep learning.

Generalized and Efficient Blackbox Optimization System.

AugLy is a data augmentations library that currently supports four modalities (audio, image, text & video) and over 100 augmentations

Code for Learning to Segment The Tail (LST)

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks

A tensorflow=1.13 implementation of Deconvolutional Networks on Graph Data (NeurIPS 2021)

SymmetryNet: Learning to Predict Reflectional and Rotational Symmetries of 3D Shapes from Single-View RGB-D Images

I will implement Fastai in each projects present in this repository.

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

This project is the PyTorch implementation of our CVPR 2022 paper:

Practical and Real-world applications of ML based on the homework of Hung-yi Lee Machine Learning Course 2021

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in ONNX

Safe Local Motion Planning with Self-Supervised Freespace Forecasting, CVPR 2021

Official PyTorch implementation for "Low Precision Decentralized Distributed Training with Heterogenous Data"