Anonymous implementation of KSL

Last update: Nov 10, 2021

Related tags

Deep Learning ksl

Overview

k-Step Latent (KSL)

Implementation of k-Step Latent (KSL) in PyTorch.

Representation Learning for Data-Efficient Reinforcement Learning

[Paper]

Code is built on top of the DrQ repo from Denis Yarats.

Getting Started

First, create and activate conda env:

conda env create -f conda_env.yml

conda activate ksl

This repo relies on environments from DMControl, and therefore assumes that you can run MuJoCo.

From within ./ksl, simply run:

python train.py

Altering training schemes can be done by feeding additional args, such as:

python train.py env=cheetah_run lr=2e-4

For a full list of customizable args, see ./ksl/configs.yaml.

Observing Runs

Just as in the DrQ repo, train.py will produce the runs folder, where all the outputs are going to be stored including train/eval logs, tensorboard blobs, and evaluation episode videos. To launch tensorboard run

tensorboard --logdir runs

The console output is also available in a form:

| train | E: 5 | S: 5000 | R: 11.4359 | D: 66.8 s | BR: 0.0581 | ALOSS: -1.0640 | CLOSS: 0.0996 | TLOSS: -23.1683 | TVAL: 0.0945 | AENT: 3.8132

a training entry decodes as

train - training episode
E - total number of episodes
S - total number of environment steps
R - episode return
D - duration in seconds
BR - average reward of a sampled batch
ALOSS - average loss of the actor
CLOSS - average loss of the critic
TLOSS - average loss of the temperature parameter
TVAL - the value of temperature
AENT - the actor's entropy

while an evaluation entry

| eval  | E: 20 | S: 20000 | R: 10.9356

contains

E - evaluation was performed after E episodes
S - evaluation was performed after S environment steps
R - average episode return computed over `num_eval_episodes` (usually 10)

Anonymous implementation of KSL

Related tags

Overview

k-Step Latent (KSL)

Getting Started

Observing Runs

Owner

Project dự đoán giá cổ phiếu bằng thuật toán LSTM gồm: code train và code demo

This reporistory contains the test-dev data of the paper "xGQA: Cross-lingual Visual Question Answering".

Cluttered MNIST Dataset

Repo for FUZE project. I will also publish some Linux kernel LPE exploits for various real world kernel vulnerabilities here. the samples are uploaded for education purposes for red and blue teams.

Film review classification

Complete the code of prefix-tuning in low data setting

This is the implementation of "SELF SUPERVISED REPRESENTATION LEARNING WITH DEEP CLUSTERING FOR ACOUSTIC UNIT DISCOVERY FROM RAW SPEECH" submitted to ICASSP 2022

🥈78th place in Riiid Answer Correctness Prediction competition

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

VOLO: Vision Outlooker for Visual Recognition

In real-world applications of machine learning, reliable and safe systems must consider measures of performance beyond standard test set accuracy

This is the source code of the solver used to compete in the International Timetabling Competition 2019.

Rax is a Learning-to-Rank library written in JAX

CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detection

Classifying cat and dog images using Kaggle dataset

Unofficial pytorch implementation of paper "One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing"

Yas CRNN model training - Yet Another Genshin Impact Scanner

Translation-equivariant Image Quantizer for Bi-directional Image-Text Generation

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"

MCMC samplers for Bayesian estimation in Python, including Metropolis-Hastings, NUTS, and Slice