"# SUPERVISED-CONTRASTIVE-LEARNING-FOR-PRE-TRAINED-LANGUAGE-MODEL-FINE-TUNING"
in this code, I've implemented sentiment analysis task with sst-2 dataset.
the below results are for 100 training samples:
cross entropy loss:
cross entropy + contrastive loss:
cross entropy heatmap on test dataset:
Accuracy on test dataset: 90.13
cross entropy + contrastive loss heatmap:
Accuracy on test dataset: 92.20
Optimum Transformers Accelerated NLP pipelines for fast inference đ on CPU and GPU. Built with đ¤ Transformers, Optimum and ONNX runtime. Installatio
MSAD Multi-Scale Aligned Distillation for Low-Resolution Detection Lu Qi*, Jason Kuen*, Jiuxiang Gu, Zhe Lin, Yi Wang, Yukang Chen, Yanwei Li, Jiaya J
Uncertainty-based OOD detection Exploring the link between uncertainty estimates obtained by "exact" Bayesian inference and out-of-distribution (OOD)
CondenseNetV2 This repository is the official Pytorch implementation for "CondenseNet V2: Sparse Feature Reactivation for Deep Networks" paper by Le Y
Anti-Backdoor Learning PyTorch Code for NeurIPS 2021 paper Anti-Backdoor Learning: Training Clean Models on Poisoned Data. The Anti-Backdoor Learning
StyleSwin This repo is the official implementation of "StyleSwin: Transformer-based GAN for High-resolution Image Generation". By Bowen Zhang, Shuyang
optimaladj: A library for computing optimal adjustment sets in causal graphical models This package implements the algorithms introduced in Smucler, S
Continuous Speech Separation with Conformer Introduction We examine the use of the Conformer architecture for continuous speech separation. Conformer
Advbox is a toolbox to generate adversarial examples that fool neural networks in PaddlePaddleăPyTorchăCaffe2ăMxNetăKerasăTensorFlow and Advbox can benchmark the robustness of machine learning models
FCN_via_Keras FCN FCN (Fully Convolutional Network) is deep fully convolutional neural network architecture for semantic pixel-wise segmentation. This
Neural ODE Processes Official code for the paper Neural ODE Processes (ICLR 2021). Abstract Neural Ordinary Differential Equations (NODEs) use a neura
Image source AdamW optimizer for bfloat16 models in pytorch. Bfloat16 is currently an optimal tradeoff between range and relative error for deep netwo
DCSL Generalizable Crowd Counting via Diverse Context Style Learning Requirement
Structured Self-attentive sentence embeddings Implementation for the paper A Structured Self-Attentive Sentence Embedding, which was published in ICLR
EWC.pytorch An implementation of Elastic Weight Consolidation (EWC), proposed in James Kirkpatrick et al. Overcoming catastrophic forgetting in neural
Unofficial PyTorch implementation of Guided Dropout This is a simple implementation of Guided Dropout for research. We try to reproduce the algorithm
DIGITS DIGITS (the Deep Learning GPU Training System) is a webapp for training deep learning models. The currently supported frameworks are: Caffe, To
Semi-supervised Semantic Segmentation with Directional Context-aware Consistency (CAC) Xin Lai*, Zhuotao Tian*, Li Jiang, Shu Liu, Hengshuang Zhao, Li
A Multi-attribute Controllable Generative Model for Histopathology Image Synthesis This is the pytorch implementation for our MICCAI 2021 paper. A Mul
neural-combinatorial-rl-pytorch PyTorch implementation of Neural Combinatorial Optimization with Reinforcement Learning. I have implemented the basic
115 Dec 16, 2022
115 Dec 23, 2022
1 Nov 05, 2022
74 Dec 12, 2022
51 Dec 07, 2022
349 Dec 28, 2022
6 Aug 04, 2022
81 Nov 28, 2022
1.3k Dec 25, 2022
48 Aug 30, 2022
50 Oct 28, 2022
8 Nov 20, 2022
3 Jun 13, 2022
488 Nov 28, 2022
166 Dec 22, 2022
2 Jan 07, 2022
4.1k Jan 03, 2023
7 Apr 04, 2022
454 Jan 06, 2023