PairNorm

Official pytorch source code for PairNorm paper (ICLR 2020)
This code requires pytorch_geometric>=1.3.2

usage

For SGC, we use original PairNorm. Notice norm_scale is data-dependent. One can choose it from {0.1, 1, 10, 50}.

python main.py --data cora --model SGC --nlayer 40 --missing_rate 100 --norm_mode PN --norm_scale 10

For GCN or GAT, we use PairNorm-SI or SCS.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN-SI --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN-SCS --residual 0

update: normalization and PN

we have found that PN works bad with symmetric normalized adjacency matrix, originally the experiments align with the paper used row-normalized adjacency matrix. What's more, we also found a small bug in the old experiments with using PN for GCN and GAT. The current version PN should works good for GCN and GAT also (haven't fully tested). Please start from using PN before testing PN-SI and PN-SCS.

For GCN or GAT, now using PN to start.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0

cite

If you use our code, please cite

@inproceedings{
zhao2020pairnorm,
title={PairNorm: Tackling Oversmoothing in {\{}GNN{\}}s},
author={Lingxiao Zhao and Leman Akoglu},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=rkecl1rtwB}
}

Source code for PairNorm (ICLR 2020)

Related tags

Overview

PairNorm

usage

update: normalization and PN

cite

Owner

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

Shuffle Attention for MobileNetV3

Practical Single-Image Super-Resolution Using Look-Up Table

Facial Image Inpainting with Semantic Control

Dynamic Attentive Graph Learning for Image Restoration, ICCV2021 [PyTorch Code]

Only works with the dashboard version / branch of jesse

Just playing with getting CLIP Guided Diffusion running locally, rather than having to use colab.

Official implementation for the paper: Multi-label Classification with Partial Annotations using Class-aware Selective Loss

MacroTools provides a library of tools for working with Julia code and expressions.

MlTr: Multi-label Classification with Transformer

Improving Non-autoregressive Generation with Mixup Training

Dynamic Token Normalization Improves Vision Transformers

A Benchmark For Measuring Systematic Generalization of Multi-Hierarchical Reasoning

A collection of resources and papers on Diffusion Models, a darkhorse in the field of Generative Models

Python Fanduel API (2021) - Lineup Automation

A platform for intelligent agent learning based on a 3D open-world FPS game developed by Inspir.AI.

HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

BarcodeRattler - A Raspberry Pi Powered Barcode Reader to load a game on the Mister FPGA using MBC

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

Code for "NeRS: Neural Reflectance Surfaces for Sparse-View 3D Reconstruction in the Wild," in NeurIPS 2021