Anonymous implementation of KSL

Last update: Nov 10, 2021

Related tags

Deep Learning ksl

Overview

k-Step Latent (KSL)

Implementation of k-Step Latent (KSL) in PyTorch.

Representation Learning for Data-Efficient Reinforcement Learning

[Paper]

Code is built on top of the DrQ repo from Denis Yarats.

Getting Started

First, create and activate conda env:

conda env create -f conda_env.yml

conda activate ksl

This repo relies on environments from DMControl, and therefore assumes that you can run MuJoCo.

From within ./ksl, simply run:

python train.py

Altering training schemes can be done by feeding additional args, such as:

python train.py env=cheetah_run lr=2e-4

For a full list of customizable args, see ./ksl/configs.yaml.

Observing Runs

Just as in the DrQ repo, train.py will produce the runs folder, where all the outputs are going to be stored including train/eval logs, tensorboard blobs, and evaluation episode videos. To launch tensorboard run

tensorboard --logdir runs

The console output is also available in a form:

| train | E: 5 | S: 5000 | R: 11.4359 | D: 66.8 s | BR: 0.0581 | ALOSS: -1.0640 | CLOSS: 0.0996 | TLOSS: -23.1683 | TVAL: 0.0945 | AENT: 3.8132

a training entry decodes as

train - training episode
E - total number of episodes
S - total number of environment steps
R - episode return
D - duration in seconds
BR - average reward of a sampled batch
ALOSS - average loss of the actor
CLOSS - average loss of the critic
TLOSS - average loss of the temperature parameter
TVAL - the value of temperature
AENT - the actor's entropy

while an evaluation entry

| eval  | E: 20 | S: 20000 | R: 10.9356

contains

E - evaluation was performed after E episodes
S - evaluation was performed after S environment steps
R - average episode return computed over `num_eval_episodes` (usually 10)

Anonymous implementation of KSL

Related tags

Overview

k-Step Latent (KSL)

Getting Started

Observing Runs

Owner

MegEngine implementation of YOLOX

HistoKT: Cross Knowledge Transfer in Computational Pathology

Library extending Jupyter notebooks to integrate with Apache TinkerPop and RDF SPARQL.

Deep Reinforcement Learning for mobile robot navigation in ROS Gazebo simulator

Code for the paper "Offline Reinforcement Learning as One Big Sequence Modeling Problem"

Interactive dimensionality reduction for large datasets

A object detecting neural network powered by the yolo architecture and leveraging the PyTorch framework and associated libraries.

Large-scale language modeling tutorials with PyTorch

Fast image augmentation library and easy to use wrapper around other libraries. Documentation: https://albumentations.ai/docs/ Paper about library: https://www.mdpi.com/2078-2489/11/2/125

Photo2cartoon - 人像卡通化探索项目 (photo-to-cartoon translation project)

Implementation of a Transformer, but completely in Triton

PaddleBoBo是基于PaddlePaddle和PaddleSpeech、PaddleGAN等开发套件的虚拟主播快速生成项目

Efficient 3D human pose estimation in video using 2D keypoint trajectories

phylotorch-bito is a package providing an interface to BITO for phylotorch

Source code for Acorn, the precision farming rover by Twisted Fields

Image-to-image regression with uncertainty quantification in PyTorch

Script that attempts to force M1 macs into RGB mode when used with monitors that are defaulting to YPbPr.

PAIRED in PyTorch 🔥

Official PyTorch implementation of the paper "Graph-based Generative Face Anonymisation with Pose Preservation" in ICIAP 2021

ML-based medical imaging using Azure