Anonymous implementation of KSL

Last update: Nov 10, 2021

Related tags

Deep Learning ksl

Overview

k-Step Latent (KSL)

Implementation of k-Step Latent (KSL) in PyTorch.

Representation Learning for Data-Efficient Reinforcement Learning

[Paper]

Code is built on top of the DrQ repo from Denis Yarats.

Getting Started

First, create and activate conda env:

conda env create -f conda_env.yml

conda activate ksl

This repo relies on environments from DMControl, and therefore assumes that you can run MuJoCo.

From within ./ksl, simply run:

python train.py

Altering training schemes can be done by feeding additional args, such as:

python train.py env=cheetah_run lr=2e-4

For a full list of customizable args, see ./ksl/configs.yaml.

Observing Runs

Just as in the DrQ repo, train.py will produce the runs folder, where all the outputs are going to be stored including train/eval logs, tensorboard blobs, and evaluation episode videos. To launch tensorboard run

tensorboard --logdir runs

The console output is also available in a form:

| train | E: 5 | S: 5000 | R: 11.4359 | D: 66.8 s | BR: 0.0581 | ALOSS: -1.0640 | CLOSS: 0.0996 | TLOSS: -23.1683 | TVAL: 0.0945 | AENT: 3.8132

a training entry decodes as

train - training episode
E - total number of episodes
S - total number of environment steps
R - episode return
D - duration in seconds
BR - average reward of a sampled batch
ALOSS - average loss of the actor
CLOSS - average loss of the critic
TLOSS - average loss of the temperature parameter
TVAL - the value of temperature
AENT - the actor's entropy

while an evaluation entry

| eval  | E: 20 | S: 20000 | R: 10.9356

contains

E - evaluation was performed after E episodes
S - evaluation was performed after S environment steps
R - average episode return computed over `num_eval_episodes` (usually 10)

Anonymous implementation of KSL

Related tags

Overview

k-Step Latent (KSL)

Getting Started

Observing Runs

Owner

SberSwap Video Swap base on deep learning

Code for LIGA-Stereo Detector, ICCV'21

This is the official repository of XVFI (eXtreme Video Frame Interpolation)

Multi-Template Mouse Brain MRI Atlas (MBMA): both in-vivo and ex-vivo

Joint Gaussian Graphical Model Estimation: A Survey

Repo for "Physion: Evaluating Physical Prediction from Vision in Humans and Machines" submission to NeurIPS 2021 (Datasets & Benchmarks track)

The description of FMFCC-A (audio track of FMFCC) dataset and Challenge resluts.

The official implementation of the paper, "SubTab: Subsetting Features of Tabular Data for Self-Supervised Representation Learning"

A PyTorch port of the Neural 3D Mesh Renderer

Implementing DeepMind's Fast Reinforcement Learning paper

Aggragrating Nested Transformer Official Jax Implementation

Official Implementation for the paper DeepFace-EMD: Re-ranking Using Patch-wise Earth Mover’s Distance Improves Out-Of-Distribution Face Identification

PyTorch Implementation of "Light Field Image Super-Resolution with Transformers"

Clairvoyance: a Unified, End-to-End AutoML Pipeline for Medical Time Series

Tool for working with Y-chromosome data from YFull and FTDNA

Curated list of awesome GAN applications and demo

Event sourced bank - A wide-and-shallow example using the Python event sourcing library

Hardware accelerated, batchable and differentiable optimizers in JAX.

Learning a mapping from images to psychological similarity spaces with neural networks.

PyTorch reimplementation of minimal-hand (CVPR2020)