2 Repositories
Latest Python Libraries
A curated list of efficient attention modules
awesome-fast-attention A curated list of efficient attention modules
Longformer: The Long-Document Transformer
Longformer Longformer and LongformerEncoderDecoder (LED) are pretrained transformer models for long documents. ***** New December 1st, 2020: Longforme