Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow

Last update: Jan 02, 2023

Related tags

Overview

AutoAugment - Learning Augmentation Policies from Data

Unofficial implementation of the ImageNet, CIFAR10 and SVHN Augmentation Policies learned by AutoAugment, described in this Google AI Blogpost.

Update July 13th, 2018: Wrote a Blogpost about AutoAugment and Double Transfer Learning.

Tested with Python 3.6. Needs pillow>=5.0.0

Example

from autoaugment import ImageNetPolicy
image = PIL.Image.open(path)
policy = ImageNetPolicy()
transformed = policy(image)

To see examples of all operations and magnitudes applied to images, take a look at AutoAugment_Exploration.ipynb.

Example as a PyTorch Transform - ImageNet

from autoaugment import ImageNetPolicy
data = ImageFolder(rootdir, transform=transforms.Compose(
                        [transforms.RandomResizedCrop(224), 
                         transforms.RandomHorizontalFlip(), ImageNetPolicy(), 
                         transforms.ToTensor(), transforms.Normalize(...)]))
loader = DataLoader(data, ...)

Example as a PyTorch Transform - CIFAR10

from autoaugment import CIFAR10Policy
data = ImageFolder(rootdir, transform=transforms.Compose(
                        [transforms.RandomCrop(32, padding=4, fill=128), # fill parameter needs torchvision installed from source
                         transforms.RandomHorizontalFlip(), CIFAR10Policy(), 
			 transforms.ToTensor(), 
                         Cutout(n_holes=1, length=16), # (https://github.com/uoguelph-mlrg/Cutout/blob/master/util/cutout.py)
                         transforms.Normalize(...)]))
loader = DataLoader(data, ...)

Example as a PyTorch Transform - SVHN

from autoaugment import SVHNPolicy
data = ImageFolder(rootdir, transform=transforms.Compose(
                        [SVHNPolicy(), 
			 transforms.ToTensor(), 
                         Cutout(n_holes=1, length=20), # (https://github.com/uoguelph-mlrg/Cutout/blob/master/util/cutout.py)
                         transforms.Normalize(...)]))
loader = DataLoader(data, ...)

Results with AutoAugment

Generalizable Data Augmentations

Finally, we show that policies found on one task can generalize well across different models and datasets. For example, the policy found on ImageNet leads to significant improvements on a variety of FGVC datasets. Even on datasets for which fine-tuning weights pre-trained on ImageNet does not help significantly [26], e.g. Stanford Cars [27] and FGVC Aircraft [28], training with the ImageNet policy reduces test set error by 1.16% and 1.76%, respectively. This result suggests that transferring data augmentation policies offers an alternative method for transfer learning.

Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow

Related tags

Overview

AutoAugment - Learning Augmentation Policies from Data

Tested with Python 3.6. Needs pillow>=5.0.0

Example

Example as a PyTorch Transform - ImageNet

Example as a PyTorch Transform - CIFAR10

Example as a PyTorch Transform - SVHN

Results with AutoAugment

Generalizable Data Augmentations

CIFAR 10

CIFAR 100

ImageNet

SVHN

Fine Grained Visual Classification Datasets

Owner

Philip Popien

QKeras: a quantization deep learning library for Tensorflow Keras

Portfolio asset allocation strategies: from Markowitz to RNNs

Scenarios, tutorials and demos for Autonomous Driving

Final Project for the CS238: Decision Making Under Uncertainty course at Stanford University in Autumn '21.

PyTorch Kafka Dataset: A definition of a dataset to get training data from Kafka.

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

SpanNER: Named EntityRe-/Recognition as Span Prediction

This repository contains small projects related to Neural Networks and Deep Learning in general.

Cross-modal Retrieval using Transformer Encoder Reasoning Networks (TERN). With use of Metric Learning and FAISS for fast similarity search on GPU

Code release for "Conditional Adversarial Domain Adaptation" (NIPS 2018)

Pytorch implementation of "Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech"

Implementation of the federated dual coordinate descent (FedDCD) method.

TyXe: Pyro-based BNNs for Pytorch users

Hashformers is a framework for hashtag segmentation with transformers.

A Jinja extension (compatible with Flask and other frameworks) to compile and/or compress your assets.

DeepDiffusion: Unsupervised Learning of Retrieval-adapted Representations via Diffusion-based Ranking on Latent Feature Manifold

Code for our TKDE paper "Understanding WeChat User Preferences and “Wow” Diffusion"

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

Cross-view Transformers for real-time Map-view Semantic Segmentation (CVPR 2022 Oral)

This is the source code of the solver used to compete in the International Timetabling Competition 2019.