3 Repositories
Latest Python Libraries
A curated list of efficient attention modules
awesome-fast-attention A curated list of efficient attention modules
891 Dec 22, 2022
Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
Linear Multihead Attention (Linformer) PyTorch Implementation of reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer:
58 Dec 23, 2022
My take on a practical implementation of Linformer for Pytorch.
Linformer Pytorch Implementation A practical implementation of the Linformer paper. This is attention with only linear complexity in n, allowing for v
349 Dec 25, 2022