Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Focal and Global Knowledge Distillation for Detectors

An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"

N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting

[AAAI 2021] EMLight: Lighting Estimation via Spherical Distribution Approximation and [ICCV 2021] Sparse Needlets for Lighting Estimation with Spherical Transport Loss

Team Enigma at ArgMining 2021 Shared Task: Leveraging Pretrained Language Models for Key Point Matching

Unsupervised Learning of Multi-Frame Optical Flow with Occlusions

PyTorch implementation of our ICCV 2021 paper, Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents.

The Python ensemble sampling toolkit for affine-invariant MCMC

An open-source Kazakh named entity recognition dataset (KazNERD), annotation guidelines, and baseline NER models.

Code for "Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations"

Hide screen when boss is approaching.

CLIPImageClassifier wraps clip image model from transformers

PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning

Computational Pathology Toolbox developed by TIA Centre, University of Warwick.

This is a vision-based 3d model manipulation and control UI

The DL Streamer Pipeline Zoo is a catalog of optimized media and media analytics pipelines.

Learning trajectory representations using self-supervision and programmatic supervision.

AirCode: A Robust Object Encoding Method

Evaluating deep transfer learning for whole-brain cognitive decoding

PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "