GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks

Last update: Dec 24, 2022

Overview

GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks

This repository implements a capsule model IntentCapsNet-ZSL on the SNIPS-NLU dataset in Python 3 with PyTorch, first introduced in the paper Zero-shot User Intent Detection via Capsule Neural Networks.

The code aims to follow PyTorch best practices, using torch instead of numpy where possible, and using .cuda() for GPU computation. Feel free to contribute via pull requests.

Requirements

python 3.6+

torch 1.0.1

numpy

gensim

scikit-learn

Usage and Modification

To run the training-validation loop: python run.py.
The custom Dataset class is implemented in dataset.py.

Acknowledgements

Original repository (TensorFlow, Python 2): https://github.com/congyingxia/ZeroShotCapsule
Re-implementation (PyTorch, Python 2): https://github.com/nhhoang96/ZeroShotCapsule-PyTorch-

Please see the following paper for the details:

Congying Xia, Chenwei Zhang, Xiaohui Yan, Yi Chang, Philip S. Yu. Zero-shot User Intent Detection via Capsule Neural Networks. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018.

https://arxiv.org/abs/1809.00385

@article{xia2018zero,
  title={Zero-shot User Intent Detection via Capsule Neural Networks},
  author={Xia, Congying and Zhang, Chenwei and Yan, Xiaohui and Chang, Yi and Yu, Philip S},
  journal={arXiv preprint arXiv:1809.00385},  
  year={2018}
}

GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks

Related tags

Overview

GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks

Requirements

Usage and Modification

Acknowledgements

References

Owner

Joel Huang

Official implementations of EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis.

Fast and Easy-to-use Distributed Graph Learning for PyTorch Geometric

S3-plugin is a high performance PyTorch dataset library to efficiently access datasets stored in S3 buckets.

A collection of extensions and data-loaders for few-shot learning & meta-learning in PyTorch

Training PyTorch models with differential privacy

PyTorch Implementation of [1611.06440] Pruning Convolutional Neural Networks for Resource Efficient Inference

higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

PyTorch implementation of TabNet paper : https://arxiv.org/pdf/1908.07442.pdf

Learning Sparse Neural Networks through L0 regularization

torch-optimizer -- collection of optimizers for Pytorch

Implements pytorch code for the Accelerated SGD algorithm.

Tacotron 2 - PyTorch implementation with faster-than-realtime inference

PyTorch extensions for fast R&D prototyping and Kaggle farming

pip install antialiased-cnns to improve stability and accuracy

A pure Python implementation of Compact Bilinear Pooling and Count Sketch for PyTorch.

PyTorch Extension Library of Optimized Autograd Sparse Matrix Operations

Differentiable SDE solvers with GPU support and efficient sensitivity analysis.

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

Tez is a super-simple and lightweight Trainer for PyTorch. It also comes with many utils that you can use to tackle over 90% of deep learning projects in PyTorch.