Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

The source code for Adaptive Kernel Graph Neural Network at AAAI2022

Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision

PyTorch code for EMNLP 2021 paper: Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System

Spectrum is an AI that uses machine learning to generate Rap song lyrics

simple_pytorch_example project is a toy example of a python script that instantiates and trains a PyTorch neural network on the FashionMNIST dataset

这是一个利用facenet和retinaface实现人脸识别的库，可以进行在线的人脸识别。

Datasets and pretrained Models for StyleGAN3 ...

patchmatch和patchmatchstereo算法的python实现

This repo provides the official code for TransBTS: Multimodal Brain Tumor Segmentation Using Transformer (https://arxiv.org/pdf/2103.04430.pdf).

nfelo: a power ranking, prediction, and betting model for the NFL

Pyramid Scene Parsing Network, CVPR2017.

Implementation of ToeplitzLDA for spatiotemporal stationary time series data.

B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Search

Two-Stage Peer-Regularized Feature Recombination for Arbitrary Image Style Transfer

Sequence lineage information extracted from RKI sequence data repo

This codebase proposes modular light python and pytorch implementations of several LiDAR Odometry methods

Implementation for our ICCV 2021 paper: Dual-Camera Super-Resolution with Aligned Attention Modules

Python3 Implementation of (Subspace Constrained) Mean Shift Algorithm in Euclidean and Directional Product Spaces

Replication Code for "Self-Supervised Bug Detection and Repair" NeurIPS 2021

Language-Driven Semantic Segmentation