This repo is built for paper: Attention Mechanisms in Computer Vision: A Survey paper
- TODO : Code about different attention mechanisms will come soon.
- TODO : Code link will come soon.
- TODO : collect more related papers. Contributions are welcome.
Channel attention
- Squeeze-and-Excitation Networks(CVPR2018) pdf, (PAMI2019 version) pdf
๐ฅ - Image superresolution using very deep residual channel attention networks(ECCV2018) pdf
๐ฅ - Context encoding for semantic segmentation(CVPR2018) pdf
๐ฅ - Spatio-temporal channel correlation networks for action classification(ECCV2018) pdf
- Global second-order pooling convolutional networks(CVPR2019) pdf
- Srm : A style-based recalibration module for convolutional neural networks(ICCV2019) pdf
- You look twice: Gaternet for dynamic filter selection in cnns(CVPR2019) pdf
- Second-order attention network for single image super-resolution(CVPR2019) pdf
๐ฅ - Spsequencenet: Semantic segmentation network on 4d point clouds(CVPR2020) pdf
- Ecanet: Efficient channel attention for deep convolutional neural networks (CVPR2020) pdf
๐ฅ - Gated channel transformation for visual recognition(CVPR2020) pdf
- Fcanet: Frequency channel attention networks(ICCV2021) pdf
Spatial attention
- Recurrent models of visual attention(NeurIPS2014), pdf
๐ฅ - Show, attend and tell: Neural image caption generation with visual attention(PMLR2015) pdf
๐ฅ - Draw: A recurrent neural network for image generation(ICML2015) pdf
๐ฅ - Spatial transformer networks(NeurIPS2015) pdf
๐ฅ - Multiple object recognition with visual attention(ICLR2015) pdf
๐ฅ - Action recognition using visual attention(arXiv2015) pdf
๐ฅ - Videolstm convolves, attends and flows for action recognition(arXiv2016) pdf
๐ฅ - Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition(CVPR2017) pdf
๐ฅ - Learning multi-attention convolutional neural network for fine-grained image recognition(ICCV2017) pdf
๐ฅ - Diversified visual attention networks for fine-grained object classification(TMM2017) pdf
๐ฅ - Attentional pooling for action recognition(NeurIPS2017) pdf
๐ฅ - Non-local neural networks(CVPR2018) pdf
๐ฅ - Attentional shapecontextnet for point cloud recognition(CVPR2018) pdf
- Relation networks for object detection(CVPR2018) pdf
๐ฅ - a2-nets: Double attention networks(NeurIPS2018) pdf
๐ฅ - Attention-aware compositional network for person re-identification(CVPR2018) pdf
๐ฅ - Tell me where to look: Guided attention inference network(CVPR2018) pdf
๐ฅ - Pedestrian alignment network for large-scale person re-identification(TCSVT2018) pdf
๐ฅ - Learn to pay attention(ICLR2018) pdf
๐ฅ - Attention U-Net: Learning Where to Look for the Pancreas(MIDL2018) pdf
๐ฅ - Psanet: Point-wise spatial attention network for scene parsing(ECCV2018) pdf
๐ฅ - Self attention generative adversarial networks(ICML2019) pdf
๐ฅ - Attentional pointnet for 3d-object detection in point clouds(CVPRW2019) pdf
- Co-occurrent features in semantic segmentation(CVPR2019) pdf
- Attention augmented convolutional networks(ICCV2019) pdf
๐ฅ - Local relation networks for image recognition(ICCV2019) pdf
- Latentgnn: Learning efficient nonlocal relations for visual recognition(ICML2019) pdf
- Graph-based global reasoning networks(CVPR2019) pdf
๐ฅ - Gcnet: Non-local networks meet squeeze-excitation networks and beyond(ICCVW2019) pdf
๐ฅ - Asymmetric non-local neural networks for semantic segmentation(ICCV2019) pdf
๐ฅ - Looking for the devil in the details: Learning trilinear attention sampling network for fine-grained image recognition(CVPR2019) pdf
- Second-order non-local attention networks for person re-identification(ICCV2019) pdf
๐ฅ - End-to-end comparative attention networks for person re-identification(ICCV2019) pdf
๐ฅ - Modeling point clouds with self-attention and gumbel subset sampling(CVPR2019) pdf
- Diagnose like a radiologist: Attention guided convolutional neural network for thorax disease classification(arXiv 2019) pdf
- L2g autoencoder: Understanding point clouds by local-to-global reconstruction with hierarchical self-attention(arXiv 2019) pdf
- Generative pretraining from pixels(PMLR2020) pdf
- Exploring self-attention for image recognition(CVPR2020) pdf
- Cf-sis: Semantic-instance segmentation of 3d point clouds by context fusion with self attention(MM20) pdf
- Disentangled non-local neural networks(ECCV2020) pdf
- Relation-aware global attention for person re-identification(CVPR2020) pdf
- Segmentation transformer: Object-contextual representations for semantic segmentation(ECCV2020) pdf
๐ฅ - Spatial pyramid based graph reasoning for semantic segmentation(CVPR2020) pdf
- Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation(CVPR2020) pdf
- End-to-end object detection with transformers(ECCV2020) pdf
๐ฅ - Pointasnl: Robust point clouds processing using nonlocal neural networks with adaptive sampling(CVPR2020) pdf
- Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers(CVPR2021) pdf
- An image is worth 16x16 words: Transformers for image recognition at scale(ICLR2021) pdf
๐ฅ - An empirical study of training selfsupervised vision transformers(CVPR2021) pdf
- Ocnet: Object context network for scene parsing(IJCV 2021) pdf
๐ฅ - Point transformer(ICCV 2021) pdf
- PCT: Point Cloud Transformer (CVMJ 2021) pdf
- Pre-trained image processing transformer(CVPR 2021) pdf
- An empirical study of training self-supervised vision transformers(ICCV 2021) pdf
- Segformer: Simple and efficient design for semantic segmentation with transformers(arxiv 2021) pdf
- Beit: Bert pre-training of image transformers(arxiv 2021) pdf
- Beyond selfattention: External attention using two linear layers for visual tasks(arxiv 2021) pdf
- Query2label: A simple transformer way to multi-label classification(arxiv 2021) pdf
- Transformer in transformer(arxiv 2021) pdf
Temporal attention
- Jointly attentive spatial-temporal pooling networks for video-based person re-identification (ICCV 2017) pdf
๐ฅ - Video person reidentification with competitive snippet-similarity aggregation and co-attentive snippet embedding(CVPR 2018) pdf
- Scan: Self-and-collaborative attention network for video person re-identification (TIP 2019) pdf
Branch attention
- Training very deep networks, (NeurIPS 2015) pdf
๐ฅ - Selective kernel networks,(CVPR 2019) pdf
๐ฅ - CondConv: Conditionally Parameterized Convolutions for Efficient Inference (NeurIPS 2019) pdf
- Dynamic convolution: Attention over convolution kernels (CVPR 2020) pdf
- ResNest: Split-attention networks (arXiv 2020) pdf
๐ฅ
ChannelSpatial attention
- Residual attention network for image classification (CVPR 2017) pdf
๐ฅ - SCA-CNN: spatial and channel-wise attention in convolutional networks for image captioning,(CVPR 2017) pdf
๐ฅ - CBAM: convolutional block attention module, (ECCV 2018) pdf
๐ฅ - Harmonious attention network for person re-identification (CVPR 2018) pdf
๐ฅ - Recalibrating fully convolutional networks with spatial and channel โsqueeze and excitationโ blocks (TMI 2018) pdf
- Mancs: A multi-task attentional network with curriculum sampling for person re-identification (ECCV 2018) pdf
๐ฅ - Bam: Bottleneck attention module(BMVC 2018) pdf
๐ฅ - Pvnet: A joint convolutional network of point cloud and multi-view for 3d shape recognition (ACM MM 2018) pdf
- Learning what and where to attend,(ICLR 2019) pdf
- Dual attention network for scene segmentation (CVPR 2019) pdf
๐ฅ - Abd-net: Attentive but diverse person re-identification (ICCV 2019) pdf
- Mixed high-order attention network for person re-identification (ICCV 2019) pdf
- Mlcvnet: Multi-level context votenet for 3d object detection (CVPR 2020) pdf
- Improving convolutional networks with self-calibrated convolutions (CVPR 2020) pdf
- Relation-aware global attention for person re-identification (CVPR 2020) pdf
- Strip Pooling: Rethinking spatial pooling for scene parsing (CVPR 2020) pdf
- Rotate to attend: Convolutional triplet attention module, (WACV 2021) pdf
- Coordinate attention for efficient mobile network design (CVPR 2021) pdf
- Simam: A simple, parameter-free attention module for convolutional neural networks (ICML 2021) pdf
SpatialTemporal attention
- An end-to-end spatio-temporal attention model for human action recognition from skeleton data(AAAI 2017) pdf
๐ฅ - Diversity regularized spatiotemporal attention for video-based person re-identification (ArXiv 2018)
๐ฅ - Interpretable spatio-temporal attention for video action recognition (ICCVW 2019) pdf
- Hierarchical lstms with adaptive attention for visual captioning, (TPAMI 2020) pdf
- Stat: Spatial-temporal attention mechanism for video captioning, (TMM 2020) pdf_link
- Gta: Global temporal attention for video action understanding (ArXiv 2020) pdf
- Multi-granularity reference-aided attentive feature aggregation for video-based person re-identification (CVPR 2020) pdf
- Read: Reciprocal attention discriminator for image-to-video re-identification, (ECCV 2020) pdf
- Decoupled spatial-temporal transformer for video inpainting (ArXiv 2021) pdf
8 Nov 14, 2022
176 Dec 28, 2022
102 Jan 07, 2023
63 Nov 23, 2022
32 Jul 19, 2022
4 Apr 07, 2022
1.4k Jan 08, 2023
62 Dec 21, 2022
177 Dec 11, 2022
746 Dec 15, 2022
12 Mar 17, 2022
0 Dec 01, 2021
363 Dec 27, 2022
0 Nov 06, 2022
56 Dec 03, 2022
11 Sep 25, 2022
1 Nov 09, 2021
139 Jan 01, 2023
6 Feb 28, 2022
18 Nov 05, 2022