TC-GNN with Pytorch integration

Last update: Dec 01, 2022

Overview

TC-GNN (Running Sparse GNN on Dense Tensor Core on Ampere GPU)

Cite this project and paper.

@inproceedings{TC-GNN,
  title={TC-GNN: Accelerating Sparse Graph Neural Network Computation Via Dense Tensor Core on GPUs},
  author={Yuke Wang and Boyuan Feng and Yufei Ding},
  booktitle={Arxiv},
  year={2022}
}

Clone this project.

git clone [email protected]:YukeWang96/TCGNN-Pytorch.git

OS & Compiler:

Ubuntu 16.04+

gcc >= 7.5

cmake >= 3.14

CUDA >= 11.0 and nvcc >= 11.0

Files and Directories.

config.py: the configuration file for the shape of a TC block.
bench.py: the benchmark file for invoking main_tcgnn.py for various datasets and models.
main_tcgnn.py: the main entry for running TC-GNN.
count_TC_blocks.py: counting the total number of TC blocks without sparse-graph translation.
proc_prof.py: get the detailed GPU kernel metrics from the ncu csv output.
TCGNN_conv/: the directory for core TC-GNN implementations, including TCGNN_kernel.cu and TCGNN.cpp.

Environment Setup.

[Method-1] Install via Docker (Recommended).

Go to Docker/
Run ./build.sh
Run ./launch.sh

[Method-2] Install via Conda.

Install conda on system Toturial.
Create a conda environment:

conda create -n env_name python=3.6

Install Pytorch:

conda install pytorch torchvision torchaudio cudatoolkit=11.1 -c pytorch -c conda-forge

or using pip [Note that make sure the pip you use is the pip from current conda environment. You can check this by which pip]

pip install torch==1.8.0+cu111 torchvision==0.9.0+cu111 torchaudio==0.8.0 -f https://download.pytorch.org/whl/torch_stable.html

Install Deep Graph Library (DGL).

conda install -c dglteam dgl-cuda11.0
pip install torch requests tqdm

Install Pytorch-Geometric (PyG).

pip install torch-scatter -f https://pytorch-geometric.com/whl/torch-1.8.0+cu111.html
pip install torch-sparse -f https://pytorch-geometric.com/whl/torch-1.8.0+cu111.html
pip install torch-cluster -f https://pytorch-geometric.com/whl/torch-1.8.0+cu111.html
pip install torch-spline-conv -f https://pytorch-geometric.com/whl/torch-1.8.0+cu111.html
pip install torch-geometric

Install `TC-GNN`.

Go to TCGNN_conv/, then run

./build.sh

to install the TCGNN_conv modules with Pytorch binding. Note that this step is required for both Docker and Conda setup.

Download graph datasets.

Get the preprocessed datasets in .npy at here, then run

tar -zxvf tcgnn-ae-graphs.tar.gz

Running PyG baseline.

Go to pyg_baseline/ directory;

Pass the --model parameter in pyg_main.py with gcn and gin to profile the example GCN and GIN model, respectively;

./0_bench.py| tee run_pyg.log to run the script and the report 10 epoch runtime for all evaluated datasets.

./1_log2csv.py to convert the run_pyg.log to run_pyg.csv for ease of analysis.

Running DGL baseline.

Go to dgl_baseline/ directory

Pass the --model parameter in dgl_main.py with gcn and gin to profile the example GCN and GIN model, respectively;

./0_bench.py| tee run_dgl.log to run the script and the report 10 epoch runtime for all evaluated datasets.

./1_log2csv.py to convert the run_dgl.log to run_dgl.csv for ease of visualization.

Running TC-GNN.

Under the current project directory

./0_bench.py| tee run_TCGNN.log to run the script and the report 10 epoch runtime for all evaluated datasets.

./1_log2csv.py to convert the run_TCGNN.log to run_TCGNN.csv for ease of analysis.

Comments

Any docs about this project?

Hi I came across this project and found the implementation is quite interesting. Is there any docs/paper that detail this project? Or you have any plan to release these kinds of information in the future?

Thanks

opened by mmmeee1111 1

Releases(v0.2)

v0.2(May 11, 2021)
Add the docker support for environment setup.

Update the path and download link of datasets.

Source code(tar.gz)
Source code(zip)
v0.1(Apr 16, 2021)

Source code(tar.gz)
Source code(zip)

🐸STT integration examples

🐸 STT 0.9.x Examples These are various examples on how to use or integrate 🐸 STT using our packages. It is a good way to just try out 🐸 STT before

92 Dec 19, 2022

Official repo for AutoInt: Automatic Integration for Fast Neural Volume Rendering in CVPR 2021

AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR 2021 Project Page | Video | Paper PyTorch implementation of automatic integration

149 Dec 22, 2022

Hand gesture recognition based whiteboard that allows you to write on live webcam. This is the first version and has features like 4 different colors, eraser and a recording option that records your session and saves it in a "recordings" folder. Use index finger to draw and two or more fingers to move around and select items. Future version will contain more functionalities like changeable thickness, color palette, integration with zoom and google meet etc.

hand-write Hand gesture recognition based whiteboard that allows you to write on live webcam. This is the first version and has features like 4 differ

27 Dec 16, 2022

An integration of several popular automatic augmentation methods, including OHL (Online Hyper-Parameter Learning for Auto-Augmentation Strategy) and AWS (Improving Auto Augment via Augmentation Wise Weight Sharing) by Sensetime Research.

45 Dec 8, 2022

Dahua Camera and Doorbell Home Assistant Integration

TC-GNN with Pytorch integration

Related tags

Overview

TC-GNN (Running Sparse GNN on Dense Tensor Core on Ampere GPU)

Files and Directories.

Environment Setup.

[Method-1] Install via Docker (Recommended).

[Method-2] Install via Conda.

Install TC-GNN.

Download graph datasets.

Running PyG baseline.

Running DGL baseline.

Running TC-GNN.

You might also like...

🐸STT integration examples

Official repo for AutoInt: Automatic Integration for Fast Neural Volume Rendering in CVPR 2021

An integration of several popular automatic augmentation methods, including OHL (Online Hyper-Parameter Learning for Auto-Augmentation Strategy) and AWS (Improving Auto Augment via Augmentation Wise Weight Sharing) by Sensetime Research.

Dahua Camera and Doorbell Home Assistant Integration

MaRS - a recursive filtering framework that allows for truly modular multi-sensor integration

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

Wafer Fault Detection using MlOps Integration

Official code for On Path Integration of Grid Cells: Group Representation and Isotropic Scaling (NeurIPS 2021)

Comments

Any docs about this project?

Releases(v0.2)

v0.2(May 11, 2021)

v0.1(Apr 16, 2021)

Owner

YUKE WANG

Mahadi-Now - This Is Pakistani Just Now Login Tools

WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose

Learning Energy-Based Models by Diffusion Recovery Likelihood

Fast Style Transfer in TensorFlow

Deep learning model, heat map, data prepo

An example showing how to use jax to train resnet50 on multi-node multi-GPU

implementation for paper "ShelfNet for fast semantic segmentation"

Point Cloud Denoising input segmentation output raw point-cloud valid/clear fog rain de-noised Abstract Lidar sensors are frequently used in environme

Data and analysis code for an MS on SK VOC genomes phenotyping/neutralisation assays

Official implementation of the paper Vision Transformer with Progressive Sampling, ICCV 2021.

A font family with a great monospaced variant for programmers.

Reproduce partial features of DeePMD-kit using PyTorch.

git《Joint Entity and Relation Extraction with Set Prediction Networks》(2020) GitHub:

a reimplementation of Optical Flow Estimation using a Spatial Pyramid Network in PyTorch

Code for NeurIPS 2021 paper 'Spatio-Temporal Variational Gaussian Processes'

An Easy-to-use, Modular and Prolongable package of deep-learning based Named Entity Recognition Models.

Video Instance Segmentation using Inter-Frame Communication Transformers (NeurIPS 2021)

Official implementation of EdiTTS: Score-based Editing for Controllable Text-to-Speech

High performance distributed framework for training deep learning recommendation models based on PyTorch.

《LXMERT: Learning Cross-Modality Encoder Representations from Transformers》(EMNLP 2020)

Install `TC-GNN`.