This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

[ACM MM 2021] Joint Implicit Image Function for Guided Depth Super-Resolution

Code for our CVPR2021 paper coordinate attention

Pytorch implementation of the paper: "SAPNet: Segmentation-Aware Progressive Network for Perceptual Contrastive Image Deraining"

Model parallel transformers in Jax and Haiku

an implementation of softmax splatting for differentiable forward warping using PyTorch

An easier way to build neural search on the cloud

Re-TACRED: Addressing Shortcomings of the TACRED Dataset

PyTorch Implementation of Vector Quantized Variational AutoEncoders.

A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.

A framework for annotating 3D meshes using the predictions of a 2D semantic segmentation model.

A repository for interferometer controller code.

Julia and Matlab codes to simulated all problems in El-Hachem, McCue and Simpson (2021)

A python library for highly configurable transformers - easing model architecture search and experimentation.

Pytorch Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic

Manifold Alignment for Semantically Aligned Style Transfer

Final project code: Implementing MAE with downscaled encoders and datasets, for ESE546 FA21 at University of Pennsylvania

NeRD: Neural Reflectance Decomposition from Image Collections

Repository for the paper : Meta-FDMixup: Cross-Domain Few-Shot Learning Guided byLabeled Target Data

Testability-Aware Low Power Controller Design with Evolutionary Learning, ITC2021

Reimplement of SimSwap training code