State of the Art Neural Networks for Deep Learning

Overview

pyradox

This python library helps you with implementing various state of the art neural networks in a totally customizable fashion using Tensorflow 2


Installation

pip install git+https://github.com/Ritvik19/pyradox.git

Usage

Modules

Module Description Input Shape Output Shape Usage
Rescale A layer that rescales the input: x_out = (x_in -mu) / sigma Arbitrary Same shape as input check here
Convolution 2D Applies 2D Convolution followed by Batch Normalization (optional) and Dropout (optional) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Densely Connected Layer followed by Batch Normalization (optional) and Dropout (optional) 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, n_units) check here
DenseNet Convolution Block A Convolution block for DenseNets 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
DenseNet Convolution Block A Convolution block for DenseNets 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
DenseNet Transition Block A Transition block for DenseNets 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Dense Skip Connection Implementation of a skip connection for densely connected layer 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, n_units) check here
VGG Module Implementation of VGG Modules with slight modifications, Applies multiple 2D Convolution followed by Batch Normalization (optional), Dropout (optional) and MaxPooling 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Conv Implementation of 2D Convolution Layer for Inception Net, Convolution Layer followed by Batch Normalization, Activation and optional Dropout 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Block Implementation on Inception Mixing Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Xception Block A customised implementation of Xception Block (Depthwise Separable Convolutions) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net Block Implementation of Efficient Net Block (Depthwise Separable Convolutions) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Conv Skip Connection Implementation of Skip Connection for Convolution Layer 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net Block Customized Implementation of ResNet Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net V2 Block Customized Implementation of ResNetV2 Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt Block Customized Implementation of ResNeXt Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Res Net Conv 2D Implementation of Convolution Layer for Inception Res Net: Convolution2d followed by Batch Norm 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Res Net Block Implementation of Inception-ResNet block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) block 8 Block 17 Block 35
NAS Net Separable Conv Block Adds 2 blocks of Separable Conv Batch Norm 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Adjust Block Adjusts the input previous path to match the shape of the input
NAS Net Normal A Cell Normal cell for NASNet-A
NAS Net Reduction A Cell Reduction cell for NASNet-A
Mobile Net Conv Block Adds an initial convolution layer with batch normalization and activation 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Mobile Net Depth Wise Conv Block Adds a depthwise convolution block. A depthwise convolution block consists of a depthwise conv, batch normalization, activation, pointwise convolution, batch normalization and activation 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inverted Res Block Adds an Inverted ResNet block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
SEBlock Adds a Squeeze Excite Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here

ConvNets

Module Description Input Shape Output Shape Usage
Generalized Dense Nets A generalization of Densely Connected Convolutional Networks (Dense Nets) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Convolutional Network 121 A modified implementation of Densely Connected Convolutional Network 121 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Convolutional Network 169 A modified implementation of Densely Connected Convolutional Network 169 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Convolutional Network 201 A modified implementation of Densely Connected Convolutional Network 201 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Generalized VGG A generalization of VGG network 4D tensor with shape (batch_shape, rows, cols, channels) 4D or 2D tensor usage 1 usage 2
VGG 16 A modified implementation of VGG16 network 4D tensor with shape (batch_shape, rows, cols, channels) 2D tensor with shape (batch_shape, new_dim) usage 1 usage 2
VGG 19 A modified implementation of VGG19 network 4D tensor with shape (batch_shape, rows, cols, channels) 2D tensor with shape (batch_shape, new_dim) usage 1 usage 2
Inception V3 Customized Implementation of Inception Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Generalized Xception Generalized Implementation of XceptionNet (Depthwise Separable Convolutions) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Xception Net A Customised Implementation of XceptionNet 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net Generalized Implementation of Effiecient Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B0 Customized Implementation of Efficient Net B0 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B1 Customized Implementation of Efficient Net B1 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B2 Customized Implementation of Efficient Net B2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B3 Customized Implementation of Efficient Net B3 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B4 Customized Implementation of Efficient Net B4 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B5 Customized Implementation of Efficient Net B5 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B6 Customized Implementation of Efficient Net B6 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B7 Customized Implementation of Efficient Net B7 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net Customized Implementation of Res Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 50 Customized Implementation of Res Net 50 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 101 Customized Implementation of Res Net 101 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 152 Customized Implementation of Res Net 152 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net V2 Customized Implementation of Res Net V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 50 V2 Customized Implementation of Res Net 50 V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 101 V2 Customized Implementation of Res Net 101 V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 152 V2 Customized Implementation of Res Net 152 V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt Customized Implementation of Res NeXt 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt 50 Customized Implementation of Res NeXt 50 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt 101 Customized Implementation of Res NeXt 101 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt 152 Customized Implementation of Res NeXt 152 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Res Net V2 Customized Implementation of Inception Res Net V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Generalised Implementation of NAS Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Mobile Customized Implementation of NAS Net Mobile 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Large Customized Implementation of NAS Net Large 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
MobileNet Customized Implementation of MobileNet 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) usage 1 usage 2
Mobile Net V2 Customized Implementation of Mobile Net V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) usage 1 usage 2
Mobile Net V3 Customized Implementation of Mobile Net V3 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) usage 1 usage 2

DenseNets

Module Description Input Shape Output Shape Usage
Densely Connected Network Network of Densely Connected Layers followed by Batch Normalization (optional) and Dropout (optional) 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, new_dim) check here
Densely Connected Resnet Network of skip connections for densely connected layer 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, new_dim) check here
You might also like...
State-of-the-art data augmentation search algorithms in PyTorch
State-of-the-art data augmentation search algorithms in PyTorch

MuarAugment Description MuarAugment is a package providing the easiest way to a state-of-the-art data augmentation pipeline. How to use You can instal

A selection of State Of The Art research papers (and code) on human locomotion (pose + trajectory) prediction (forecasting)

A selection of State Of The Art research papers (and code) on human trajectory prediction (forecasting). Papers marked with [W] are workshop papers.

A state of the art of new lightweight YOLO model implemented by TensorFlow 2.
A state of the art of new lightweight YOLO model implemented by TensorFlow 2.

CSL-YOLO: A New Lightweight Object Detection System for Edge Computing This project provides a SOTA level lightweight YOLO called "Cross-Stage Lightwe

We evaluate our method on different datasets (including ShapeNet, CUB-200-2011, and Pascal3D+) and achieve state-of-the-art results, outperforming all the other supervised and unsupervised methods and 3D representations, all in terms of performance, accuracy, and training time. FastReID is a research platform that implements state-of-the-art re-identification algorithms.
FastReID is a research platform that implements state-of-the-art re-identification algorithms.

FastReID is a research platform that implements state-of-the-art re-identification algorithms.

Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.
Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.

Summary Explorer Summary Explorer is a tool to visually inspect the summaries from several state-of-the-art neural summarization models across multipl

PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+
PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

PaddlePaddle Vision Transformers State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 🤖 PaddlePaddle Visual Transformers (PaddleViT or

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

English | 简体中文 | 繁體中文 State-of-the-art Natural Language Processing for Jax, PyTorch and TensorFlow 🤗 Transformers provides thousands of pretrained mo

Fuzzification helps developers protect the released, binary-only software from attackers who are capable of applying state-of-the-art fuzzing techniques

About Fuzzification Fuzzification helps developers protect the released, binary-only software from attackers who are capable of applying state-of-the-

Comments
Releases(v1.0.1)
Owner
Ritvik Rastogi
I have been writing code since 2016, and taught myself a handful of skills and programming languages. I love solving problems by writing code
Ritvik Rastogi
GBIM(Gesture-Based Interaction map)

手势交互地图 GBIM(Gesture-Based Interaction map),基于视觉深度神经网络的交互地图,通过电脑摄像头观察使用者的手势变化,进而控制地图进行简单的交互。网络使用PaddleX提供的轻量级模型PPYOLO Tiny以及MobileNet V3 small,使得整个模型大小约10MB左右,即使在CPU下也能快速定位和识别手势。

8 Feb 10, 2022
We provided a matlab implementation for an evolutionary multitasking AUC optimization framework (EMTAUC).

EMTAUC We provided a matlab implementation for an evolutionary multitasking AUC optimization framework (EMTAUC). In this code, SBGA is considered a ba

7 Nov 24, 2022
Official PyTorch implementation of the Fishr regularization for out-of-distribution generalization

Fishr: Invariant Gradient Variances for Out-of-distribution Generalization Official PyTorch implementation of the Fishr regularization for out-of-dist

62 Dec 22, 2022
ANEA: Automated (Named) Entity Annotation for German Domain-Specific Texts

ANEA The goal of Automatic (Named) Entity Annotation is to create a small annotated dataset for NER extracted from German domain-specific texts. Insta

Anastasia Zhukova 2 Oct 07, 2022
Project NII pytorch scripts

project-NII-pytorch-scripts By Xin Wang, National Institute of Informatics, since 2021 I am a new pytorch user. If you have any suggestions or questio

Yamagishi and Echizen Laboratories, National Institute of Informatics 184 Dec 23, 2022
Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)

Realtime Multi-Person Pose Estimation By Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. Introduction Code repo for winning 2016 MSCOCO Keypoints Cha

Zhe Cao 4.9k Dec 31, 2022
A computer vision pipeline to identify the "icons" in Christian paintings

Christian-Iconography A computer vision pipeline to identify the "icons" in Christian paintings. A bit about iconography. Iconography is related to id

Rishab Mudliar 3 Jul 30, 2022
A PyTorch implementation of "TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?"

TokenLearner: What Can 8 Learned Tokens Do for Images and Videos? Source: Improving Vision Transformer Efficiency and Accuracy by Learning to Tokenize

Caiyong Wang 14 Sep 20, 2022
This repository includes different versions of the prescribed-time controller as Simulink blocks and MATLAB script codes for engineering applications.

Prescribed-time Control Prescribed-time control (PTC) blocks in Simulink environment, MATLAB R2020b. For more theoretical details, refer to the papers

Amir Shakouri 1 Mar 11, 2022
exponential adaptive pooling for PyTorch

AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsampling Abstract Pooling layers are essential building blocks of Convolutional Ne

Alexandros Stergiou 55 Jan 04, 2023
Code for Ditto: Building Digital Twins of Articulated Objects from Interaction

Ditto: Building Digital Twins of Articulated Objects from Interaction Zhenyu Jiang, Cheng-Chun Hsu, Yuke Zhu CVPR 2022, Oral Project | arxiv News 2022

UT Robot Perception and Learning Lab 78 Dec 22, 2022
An efficient framework for reinforcement learning.

rl: An efficient framework for reinforcement learning Requirements Introduction PPO Test Requirements name version Python =3.7 numpy =1.19 torch =1

16 Nov 30, 2022
RLBot Python bindings for the Rust crate rl_ball_sym

RLBot Python bindings for rl_ball_sym 0.6 Prerequisites: Rust & Cargo Build Tools for Visual Studio RLBot - Verify that the file %localappdata%\RLBotG

Eric Veilleux 2 Nov 25, 2022
Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral

Good news! We release a clean version of PVNet: clean-pvnet, including how to train the PVNet on the custom dataset. Use PVNet with a detector. The tr

ZJU3DV 722 Dec 27, 2022
Image augmentation library in Python for machine learning.

Augmentor is an image augmentation library in Python for machine learning. It aims to be a standalone library that is platform and framework independe

Marcus D. Bloice 4.8k Jan 07, 2023
Expressive Power of Invariant and Equivaraint Graph Neural Networks (ICLR 2021)

Expressive Power of Invariant and Equivaraint Graph Neural Networks In this repository, we show how to use powerful GNN (2-FGNN) to solve a graph alig

Marc Lelarge 36 Dec 12, 2022
Creating predictive checklists from data using integer programming.

Learning Optimal Predictive Checklists A Python package to learn simple predictive checklists from data subject to customizable constraints. For more

Healthy ML 5 Apr 19, 2022
The Adapter-Bot: All-In-One Controllable Conversational Model

The Adapter-Bot: All-In-One Controllable Conversational Model This is the implementation of the paper: The Adapter-Bot: All-In-One Controllable Conver

CAiRE 37 Nov 04, 2022
Convert weight file.pth to weight file.blob

CONVERT YOUR MODEL TO IR FORMAT INSTALLATION OpenVino Toolkit Download openvinotoolkit 2021.3 version : Link Instruction of installation : Link Pytorc

Tran Anh Tuan 3 Nov 18, 2021
PyTorch implementation of the method described in the paper VoiceLoop: Voice Fitting and Synthesis via a Phonological Loop.

VoiceLoop PyTorch implementation of the method described in the paper VoiceLoop: Voice Fitting and Synthesis via a Phonological Loop. VoiceLoop is a n

Meta Archive 873 Dec 15, 2022