HIGL
This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).
Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)
Installation
conda create -n higl python=3.6
conda activate higl
./install_all.sh
Also, to run the MuJoCo experiments, a license is required (see here).
Usage
Training & Evaluation
- Point Maze
./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2
- Ant Maze (U-shape)
./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2
- Ant Maze (W-shape)
./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2
- Reacher & Pusher
./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2
- Stochastic Ant Maze (U-shape)
./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2
83 Jan 01, 2023
166 Dec 28, 2022
1 Feb 09, 2022
14 Nov 24, 2022
7 Dec 07, 2022
205 Jan 05, 2023
205 Jan 09, 2023
1.2k Jan 04, 2023
5 Nov 18, 2022
613 Jan 05, 2023
12 Mar 19, 2022
906 Dec 30, 2022
21 Dec 23, 2022
12 Oct 19, 2022
[email protected]&L">
603 Jan 05, 2023
1.5k Dec 27, 2022
330 Jan 06, 2023
1 Nov 13, 2021
7 Jan 02, 2022
0 Feb 09, 2022