An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Last update: Nov 09, 2021

Related tags

Deep Learning EquivariantSelfAttention

Overview

EquivariantSelfAttention

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

This work extends and builds on previous work:

FR Classification using e2cnn, whose code is here.
Attention for FR Classificaion, whose code is here. This work makes extensive use of the e2cnn package: e2cnn.

Imports for General Use

import os
import torch
import e2cnn
import pandas as pd
import numpy as np
import configparser as ConfigParser

import utils

Loading a network:

To load a network import the network files, read in a config file, and load the network with the config file parameters:

from networks import AGRadGalNet, VanillaLeNet, testNet, DNSteerableLeNet, DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = locals()[config['model']['base']](**config['model']).to(device)

Alternatively, if you know which architecture you want to use, only import that and load in the config parameters (i.e. without using locals()):

from networks import DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = DNSteerableAGRadGalNet(**config['model']).to(device)

Loading a model:

To load the best performing model (according to early stopping) from a given model training session:

path_supliment = config['data']['augment']+'/'
model = utils.utils.load_model(config, load_model='best', device=device, path_supliment=path_supliment)

Testing a model:

Follow the example of evaluation.ipynb for model evaluation.

Defining a model:

To define your own model simply create a new config which follows the examples provided in configs.

Training a model:

To train a model use the train.py using your config file:

python3.8 train.py --config YOUR_CONFIG_NAME.cfg >& logs/YOUR_CONFIG_NAME.log

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

A facial recognition doorbell system using a Raspberry Pi

An implementation of Geoffrey Hinton's paper "How to represent part-whole hierarchies in a neural network" in Pytorch.

Code for paper "ASAP-Net: Attention and Structure Aware Point Cloud Sequence Segmentation"

A semismooth Newton method for elliptic PDE-constrained optimization

NeurIPS 2021, self-supervised 6D pose on category level

Code to compute permutation and drop-column importances in Python scikit-learn models

Understanding Convolutional Neural Networks from Theoretical Perspective via Volterra Convolution

U2-Net: Going Deeper with Nested U-Structure for Salient Object Detection

The official PyTorch implementation for the paper "sMGC: A Complex-Valued Graph Convolutional Network via Magnetic Laplacian for Directed Graphs".

This repository contains the code for our paper VDA (public in EMNLP2021 main conference)

pytorch implementation of trDesign

Leveraging Two Types of Global Graph for Sequential Fashion Recommendation, ICMR 2021

KAPAO is an efficient multi-person human pose estimation model that detects keypoints and poses as objects and fuses the detections to predict human poses.

Large-scale Hyperspectral Image Clustering Using Contrastive Learning, CIKM 21 Workshop

HMLET (Hybrid-Method-of-Linear-and-non-linEar-collaborative-filTering-method)

Robotic Process Automation in Windows and Linux by using Driagrams.net BPMN diagrams.

Official code of CVPR 2021's PLOP: Learning without Forgetting for Continual Semantic Segmentation

Semi-supervised Implicit Scene Completion from Sparse LiDAR

A keras-based real-time model for medical image segmentation (CFPNet-M)

This is the formal code implementation of the CVPR 2022 paper 'Federated Class Incremental Learning'.