Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow

Last update: Jan 02, 2023

Related tags

Overview

AutoAugment - Learning Augmentation Policies from Data

Unofficial implementation of the ImageNet, CIFAR10 and SVHN Augmentation Policies learned by AutoAugment, described in this Google AI Blogpost.

Update July 13th, 2018: Wrote a Blogpost about AutoAugment and Double Transfer Learning.

Tested with Python 3.6. Needs pillow>=5.0.0

Example

from autoaugment import ImageNetPolicy
image = PIL.Image.open(path)
policy = ImageNetPolicy()
transformed = policy(image)

To see examples of all operations and magnitudes applied to images, take a look at AutoAugment_Exploration.ipynb.

Example as a PyTorch Transform - ImageNet

from autoaugment import ImageNetPolicy
data = ImageFolder(rootdir, transform=transforms.Compose(
                        [transforms.RandomResizedCrop(224), 
                         transforms.RandomHorizontalFlip(), ImageNetPolicy(), 
                         transforms.ToTensor(), transforms.Normalize(...)]))
loader = DataLoader(data, ...)

Example as a PyTorch Transform - CIFAR10

from autoaugment import CIFAR10Policy
data = ImageFolder(rootdir, transform=transforms.Compose(
                        [transforms.RandomCrop(32, padding=4, fill=128), # fill parameter needs torchvision installed from source
                         transforms.RandomHorizontalFlip(), CIFAR10Policy(), 
			 transforms.ToTensor(), 
                         Cutout(n_holes=1, length=16), # (https://github.com/uoguelph-mlrg/Cutout/blob/master/util/cutout.py)
                         transforms.Normalize(...)]))
loader = DataLoader(data, ...)

Example as a PyTorch Transform - SVHN

from autoaugment import SVHNPolicy
data = ImageFolder(rootdir, transform=transforms.Compose(
                        [SVHNPolicy(), 
			 transforms.ToTensor(), 
                         Cutout(n_holes=1, length=20), # (https://github.com/uoguelph-mlrg/Cutout/blob/master/util/cutout.py)
                         transforms.Normalize(...)]))
loader = DataLoader(data, ...)

Results with AutoAugment

Generalizable Data Augmentations

Finally, we show that policies found on one task can generalize well across different models and datasets. For example, the policy found on ImageNet leads to significant improvements on a variety of FGVC datasets. Even on datasets for which fine-tuning weights pre-trained on ImageNet does not help significantly [26], e.g. Stanford Cars [27] and FGVC Aircraft [28], training with the ImageNet policy reduces test set error by 1.16% and 1.76%, respectively. This result suggests that transferring data augmentation policies offers an alternative method for transfer learning.

Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow

Related tags

Overview

AutoAugment - Learning Augmentation Policies from Data

Tested with Python 3.6. Needs pillow>=5.0.0

Example

Example as a PyTorch Transform - ImageNet

Example as a PyTorch Transform - CIFAR10

Example as a PyTorch Transform - SVHN

Results with AutoAugment

Generalizable Data Augmentations

CIFAR 10

CIFAR 100

ImageNet

SVHN

Fine Grained Visual Classification Datasets

Owner

Philip Popien

Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

Code and data accompanying our SVRHM'21 paper.

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains (IJCV submission)

TensorFlow implementation of "Variational Inference with Normalizing Flows"

It's like Shape Editor in Maya but works with skeletons (transforms).

A collection of Reinforcement Learning algorithms from Sutton and Barto's book and other research papers implemented in Python.

Semantic Segmentation Suite in TensorFlow

Repo for parser tensorflow(.pb) and tflite(.tflite)

Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers (arXiv2021)

Understanding the Generalization Benefit of Model Invariance from a Data Perspective

Open-World Entity Segmentation

DirectVoxGO reconstructs a scene representation from a set of calibrated images capturing the scene.

Keras Model Implementation Walkthrough

In generative deep geometry learning, we often get many obj files remain to be rendered

A forwarding MPI implementation that can use any other MPI implementation via an MPI ABI

Material for my PyConDE & PyData Berlin 2022 Talk "5 Steps to Speed Up Your Data-Analysis on a Single Core"

Gym-TORCS is the reinforcement learning (RL) environment in TORCS domain with OpenAI-gym-like interface.

Implementation of SSMF: Shifting Seasonal Matrix Factorization

ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detection