Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

yolox_backbone is a deep-learning library and is a collection of YOLOX Backbone models.

Post-Training Quantization for Vision transformers.

i-RevNet Pytorch Code

Official PyTorch implementation of "Improving Face Recognition with Large AgeGaps by Learning to Distinguish Children" (BMVC 2021)

Code for the paper "SmoothMix: Training Confidence-calibrated Smoothed Classifiers for Certified Robustness" (NeurIPS 2021)

QR2Pass-project - A proof of concept for an alternative (passwordless) authentication system to a web server

[NeurIPS 2021] Low-Rank Subspaces in GANs

This is a five-step framework for the development of intrusion detection systems (IDS) using machine learning (ML) considering model realization, and performance evaluation.

Implementation for paper: Self-Regulation for Semantic Segmentation

A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.

DeepI2I: Enabling Deep Hierarchical Image-to-Image Translation by Transferring from GANs

1st-in-MICCAI2020-CPM - Combined Radiology and Pathology Classification

This repo contains source code and materials for the TEmporally COherent GAN SIGGRAPH project.

Official repository for GCR rerank, a GCN-based reranking method for both image and video re-ID

(JMLR' 19) A Python Toolbox for Scalable Outlier Detection (Anomaly Detection)

DIVeR: Deterministic Integration for Volume Rendering

DGCNN - Dynamic Graph CNN for Learning on Point Clouds

Official Implementation of LARGE: Latent-Based Regression through GAN Semantics

RoIAlign & crop_and_resize for PyTorch

PyTorch implementation of Asymmetric Siamese (https://arxiv.org/abs/2204.00613)