Offline Reinforcement Learning with Implicit Q-Learning

Last update: Dec 31, 2022

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Libtorch yolov3 deepsort

Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Concept drift monitoring for HA model servers.

Using contrastive learning and OpenAI's CLIP to find good embeddings for images with lossy transformations

Neural Koopman Lyapunov Control

Point cloud processing tool library.

Scikit-event-correlation - Event Correlation and Forecasting over High Dimensional Streaming Sensor Data algorithms

A benchmark dataset for emulating atmospheric radiative transfer in weather and climate models with machine learning (NeurIPS 2021 Datasets and Benchmarks Track)

A distributed, plug-n-play algorithm for multi-robot applications with a priori non-computable objective functions

Based on the paper "Geometry-aware Instance-reweighted Adversarial Training" ICLR 2021 oral

This is an easy python software which allows to sort images with faces by gender and after by age.

This is the accompanying toolbox for the paper "A Survey on GANs for Anomaly Detection"

Machine Unlearning with SISA

Code for "The Box Size Confidence Bias Harms Your Object Detector"

UnsupervisedR&R: Unsupervised Pointcloud Registration via Differentiable Rendering

Chinese Mandarin tts text-to-speech 中文 (普通话) 语音合成 , by fastspeech 2 , implemented in pytorch, using waveglow as vocoder,

Scientific Computation Methods in C and Python (Open for Hacktoberfest 2021)

Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel

Securetar - A streaming wrapper around python tarfile and allow secure handling files and support encryption

Pytorch implementation of 'Fingerprint Presentation Attack Detector Using Global-Local Model'

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Libtorch yolov3 deepsort

Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Concept drift monitoring for HA model servers.

Using contrastive learning and OpenAI's CLIP to find good embeddings for images with lossy transformations

Neural Koopman Lyapunov Control

Point cloud processing tool library.

Scikit-event-correlation - Event Correlation and Forecasting over High Dimensional Streaming Sensor Data algorithms

A benchmark dataset for emulating atmospheric radiative transfer in weather and climate models with machine learning (NeurIPS 2021 Datasets and Benchmarks Track)

A distributed, plug-n-play algorithm for multi-robot applications with a priori non-computable objective functions

Based on the paper "Geometry-aware Instance-reweighted Adversarial Training" ICLR 2021 oral

This is an easy python software which allows to sort images with faces by gender and after by age.

This is the accompanying toolbox for the paper "A Survey on GANs for Anomaly Detection"

Machine Unlearning with SISA

Code for "The Box Size Confidence Bias Harms Your Object Detector"

UnsupervisedR&R: Unsupervised Pointcloud Registration via Differentiable Rendering

Chinese Mandarin tts text-to-speech 中文 (普通话) 语音 合成 , by fastspeech 2 , implemented in pytorch, using waveglow as vocoder,

Scientific Computation Methods in C and Python (Open for Hacktoberfest 2021)

Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel

Securetar - A streaming wrapper around python tarfile and allow secure handling files and support encryption

Pytorch implementation of 'Fingerprint Presentation Attack Detector Using Global-Local Model'

Chinese Mandarin tts text-to-speech 中文 (普通话) 语音合成 , by fastspeech 2 , implemented in pytorch, using waveglow as vocoder,