Source for the paper "Universal Activation Function for machine learning"

Last update: Dec 03, 2022

Overview

Universal Activation Function

Tensorflow and Pytorch source code for the paper

Yuen, Brosnan, Minh Tu Hoang, Xiaodai Dong, and Tao Lu. "Universal activation function for machine learning." Scientific reports 11, no. 1 (2021): 1-11.

Getting the code

Requires Docker

Use git to pull this repo

git clone https://github.com/SensorOrgNet/Universal_Activation_Function.git

Running the Tensorflow 2 version

Install CUDA 11.2 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.2.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install tensorflow==2.7.0

Run the MLP with UAF for MNIST dataset

cd   Universal_Activation_Function/tensorflow/
python3   ./mnist_UAF.py

Running the Pytorch version

Install CUDA 11.3 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.3.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
pip3 install torch-scatter -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-sparse -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-cluster -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-spline-conv -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-geometric

Run the CNN with UAF for MNIST dataset

cd   Universal_Activation_Function/pytorch/
python3   ./mnist_UAF.py

Run the GCN2 with UAF for CORA dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./gcn2_cora_UAF.py  0

Run the PNA with UAF for ZNC dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./pna_UAF.py  0

Source for the paper "Universal Activation Function for machine learning"

Related tags

Overview

Universal Activation Function

Getting the code

Running the Tensorflow 2 version

Running the Pytorch version

Owner

This repository contains the code for "SBEVNet: End-to-End Deep Stereo Layout Estimation" paper by Divam Gupta, Wei Pu, Trenton Tabor, Jeff Schneider

RGBD-Net - This repository contains a pytorch lightning implementation for the 3DV 2021 RGBD-Net paper.

Implementation of Sequence Generative Adversarial Nets with Policy Gradient

A very lightweight monitoring system for Raspberry Pi clusters running Kubernetes.

Network Pruning That Matters: A Case Study on Retraining Variants (ICLR 2021)

Codes for our paper The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders published to EMNLP 2021.

Framework for training options with different attention mechanism and using them to solve downstream tasks.

PyTorch 1.5 implementation for paper DECOR-GAN: 3D Shape Detailization by Conditional Refinement.

Breaching - Breaching privacy in federated learning scenarios for vision and text

Dirty Pixels: Towards End-to-End Image Processing and Perception

Python package for missing-data imputation with deep learning

Zsseg.baseline - Zero-Shot Semantic Segmentation

Run Keras models in the browser, with GPU support using WebGL

A coin flip game in which you can put the amount of money below or equal to 1000 and then choose heads or tail

PyTorch implementation of our ICCV2021 paper: StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimation

LexGLUE: A Benchmark Dataset for Legal Language Understanding in English

Fast Axiomatic Attribution for Neural Networks (NeurIPS*2021)

Official PyTorch implementation of paper: Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentation (ICCV 2021 Oral Presentation)

The story of Chicken for Club Bing

AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation