Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Instance Semantic Segmentation List

Learning Open-World Object Proposals without Learning to Classify

Code for unmixing audio signals in four different stems "drums, bass, vocals, others". The code is adapted from "Jukebox: A Generative Model for Music"

Pytorch implementation of Compressive Transformers, from Deepmind

Tutorial on active learning with the Nvidia Transfer Learning Toolkit (TLT).

"Exploring Vision Transformers for Fine-grained Classification" at CVPRW FGVC8

Open-World Entity Segmentation

This is the official PyTorch implementation of the CVPR 2020 paper "TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting".

Learning Temporal Consistency for Low Light Video Enhancement from Single Images (CVPR2021)

Share a benchmark that can easily apply reinforcement learning in Job-shop-scheduling

make ASCII Art by Deep Learning

Set of methods to ensemble boxes from different object detection models, including implementation of "Weighted boxes fusion (WBF)" method.

TextBPN Adaptive Boundary Proposal Network for Arbitrary Shape Text Detection

This repository contains the code for the binaural-detection model used in the publication arXiv:2111.04637

PyTorch implementation of the paper Ultra Fast Structure-aware Deep Lane Detection

Provided is code that demonstrates the training and evaluation of the work presented in the paper: "On the Detection of Digital Face Manipulation" published in CVPR 2020.

This is the source code for: Context-aware Entity Typing in Knowledge Graphs.

GemNet model in PyTorch, as proposed in "GemNet: Universal Directional Graph Neural Networks for Molecules" (NeurIPS 2021)

Code for the Paper: Alexandra Lindt and Emiel Hoogeboom.

Milano is a tool for automating hyper-parameters search for your models on a backend of your choice.