ColossalAI-Examples - Examples of training models with hybrid parallelism using ColossalAI

Last update: Jan 09, 2023

Related tags

Deep Learning ColossalAI-Examples

Overview

ColossalAI-Examples

This repository contains examples of training models with ColossalAI. These examples fall under three categories:

Computer Vision
Natural Language Processing
General examples to demonstrate ColossalAI's features

Discussion

Discussion about the Colossal-AI project and examples is always welcomed! We would love to exchange ideas with the community to better help this project grow. If you think there is a need to discuss anything, you may jump to our dicussion forum and create a topic there.

If you encounter any problem while running these examples, you may want to raise an issue in this repository.

Contributing

This project welcomes constructive ideas and implementations from the community. If you wish to add an example for a specific application, please commit your code either in the image or language folders. If you wish to add new examples to explain our features, you can commit your code in the features folder, we may invite you to put up a tutorial or blog in ColossalAI Documentation.

ColossalAI-Examples - Examples of training models with hybrid parallelism using ColossalAI

Related tags

Overview

ColossalAI-Examples

Discussion

Contributing

Owner

HPC-AI Tech

A lightweight deep network for fast and accurate optical flow estimation.

This project intends to use SVM supervised learning to determine whether or not an individual is diabetic given certain attributes.

Keyword spotting on Arm Cortex-M Microcontrollers

This repository contains the code for the paper Neural RGB-D Surface Reconstruction

Molecular AutoEncoder in PyTorch

It's a powerful version of linebot

Breast cancer is been classified into benign tumour and malignant tumour.

Simultaneous NMT/MMT framework in PyTorch

Pairwise learning neural link prediction for ogb link prediction

This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detection, built on SECOND.

The official implementation of A Unified Game-Theoretic Interpretation of Adversarial Robustness.

Code of 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces

Code base for "On-the-Fly Test-time Adaptation for Medical Image Segmentation"

BMVC 2021 Oral: code for BI-GCN: Boundary-Aware Input-Dependent Graph Convolution for Biomedical Image Segmentation

ByteTrack超详细教程！训练自己的数据集&&摄像头实时检测跟踪

Image processing in Python

Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)

Source code for paper "Deep Superpixel-based Network for Blind Image Quality Assessment"

Variational Attention: Propagating Domain-Specific Knowledge for Multi-Domain Learning in Crowd Counting (ICCV, 2021)

Demonstrates how to divide a DL model into multiple IR model files (division) and introduce a simplest way to implement a custom layer works with OpenVINO IR models.