Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Context-Sensitive Misspelling Correction of Clinical Text via Conditional Independence, CHIL 2022

Reference implementation for Deep Unsupervised Learning using Nonequilibrium Thermodynamics

AOT-GAN for High-Resolution Image Inpainting (codebase for image inpainting)

HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDAR. CVPR 2022

Official implementation of "Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervision" ECCV2020

JAX-based neural network library

vit for few-shot classification

Dense Unsupervised Learning for Video Segmentation (NeurIPS*2021)

OcclusionFusion: realtime dynamic 3D reconstruction based on single-view RGB-D

This repository contains small projects related to Neural Networks and Deep Learning in general.

Scalable Graph Neural Networks for Heterogeneous Graphs

General purpose Slater-Koster tight-binding code for electronic structure calculations

Shuffle Attention for MobileNetV3

DRLib：A concise deep reinforcement learning library, integrating HER and PER for almost off policy RL algos.

ECCV2020 paper: Fashion Captioning: Towards Generating Accurate Descriptions with Semantic Rewards. Code and Data.

Weakly Supervised 3D Object Detection from Point Cloud with Only Image Level Annotation

SwinIR: Image Restoration Using Swin Transformer

Perfect implement. Model shared. x0.5 (Top1:60.646) and 1.0x (Top1:69.402).

A 3D sparse LBM solver implemented using Taichi

AWS provides a Python SDK, "Boto3" ,which can be used to access the AWS-account from the local.