Skip to content

This repository contains an overview of important follow-up works based on the original Vision Transformer (ViT) by Google.

Notifications You must be signed in to change notification settings

NielsRogge/Vision-Transformer-papers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 

Repository files navigation

Vision-Transformer-papers

This repository contains a (non-exhaustive) overview of follow-up works based on the original Vision Transformer (ViT) by Google. Feel free to open a PR to add more papers!

Distillation:

New pre-training objectives:

New pre-training tricks, techniques:

Architectural changes:

Investigations of the inner workings (cfr. BERTology):

Applying ViT to other domains besides image classification:

About

This repository contains an overview of important follow-up works based on the original Vision Transformer (ViT) by Google.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published