PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

ARM-Net: Adaptive Relation Modeling Network for Structured Data

This repository contains our PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data. We also provide the implementation of relevant baseline models for structured (tabular) data learning.

Our lightweight framework for structured data analytics implemented in Singa can be found in our project site.

Benchmark Dataset

Baseline Model

Model	Code	Reference
Logistic Regression	LR, lr.py
Factorization Machine	FM, fm.py	S Rendle, Factorization Machines, 2010.
Attentional Factorization Machine	AFM, afm.py	J Xiao, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks, 2017.
Higher-Order Factorization Machines	HOFM, hofm.py	M Blondel, et al. Higher-Order Factorization Machines, 2016.
Deep Neural Network	DNN, dnn.py
Graph Convolutional Networks	GCN, gcn.py	T Kipf, et al. Semi-Supervised Classification with Graph Convolutional Networks, 2016.
Graph Convolutional Networks	GAT, gat.py	P Veličković, et al. Graph Attention Networks, 2017.
Wide&Deep	Wide&Deep, wd.py	HT Cheng, et al. Wide & Deep Learning for Recommender Systems, 2016.
Product Neural Network	IPNN/KPNN, pnn.py	Y Qu, et al. Product-based Neural Networks for User Response Prediction, 2016.
Neural Factorization Machine	NFM, nfm.py	X He and TS Chua, Neural Factorization Machines for Sparse Predictive Analytics, 2017.
DeepFM	DeepFM, dfm.py	H Guo, et al. DeepFM: A Factorization-Machine based Neural Network for CTR Prediction, 2017.
Deep & Cross Network	DCN/DCN+, dcn.py	R Wang, et al. Deep & Cross Network for Ad Click Predictions, 2017.
Gated Linear Unit	SA_GLU, sa_glu.py	Y N. Dauphin, et al. Language Modeling with Gated Convolutional Networks, 2017
xDeepFM	CIN/xDeepFM, xdfm.py	J Lian, et al. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems, 2018.
Context-Aware Self-Attention Network	GC_ARM, gc_arm.py	B Yang, et al. Context-Aware Self-Attention Networks, 2019
AFN	AFN/AFN+, afn.py	W Cheng, et al. Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions, 2020.
ARM-Net	ARM-Net/ARM-Net+, armnet.py	S Cai, et al. ARM-Net: Adaptive Relation Modeling Network for Structured Data, 2021.

Citation

If you use our code in your research, please kindly cite:

@inproceedings{DBLP:conf/sigmod/CaiZ0JOZ21,
  author    = {Shaofeng Cai and
               Kaiping Zheng and
               Gang Chen and
               H. V. Jagadish and
               Beng Chin Ooi and
               Meihui Zhang},
  title     = {ARM-Net: Adaptive Relation Modeling Network for Structured Data},
  booktitle = {{SIGMOD} '21: International Conference on Management of Data, Virtual
               Event, China, June 20-25, 2021},
  pages     = {207--220},
  publisher = {{ACM}},
  year      = {2021},
}

Contact

To ask questions or report issues, you can directly drop us an email.

PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

Related tags

Overview

ARM-Net: Adaptive Relation Modeling Network for Structured Data

Benchmark Dataset

Baseline Model

Citation

Contact

Owner

A strongly-typed genetic programming framework for Python

Implementation of CSRL from the AAAI2022 paper: Constraint Sampling Reinforcement Learning: Incorporating Expertise For Faster Learning

Tensorflow port of a full NetVLAD network

Multivariate Boosted TRee

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Container : Context Aggregation Network

(AAAI2020)Grapy-ML: Graph Pyramid Mutual Learning for Cross-dataset Human Parsing

Implementation for the paper SMPLicit: Topology-aware Generative Model for Clothed People (CVPR 2021)

PyTorch implementation of Off-policy Learning in Two-stage Recommender Systems

An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters

Enhancing Column Generation by a Machine-Learning-BasedPricing Heuristic for Graph Coloring

a delightful machine learning tool that allows you to train, test and use models without writing code

Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision. ICCV 2021.

[CVPR'21] Projecting Your View Attentively: Monocular Road Scene Layout Estimation via Cross-view Transformation

An implementation of the proximal policy optimization algorithm

Experiments for distributed optimization algorithms

Establishing Strong Baselines for TripClick Health Retrieval; ECIR 2022

Model parallel transformers in Jax and Haiku

Code for ICCV 2021 paper: ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generators..

A powerful framework for decentralized federated learning with user-defined communication topology