Learning-Rate-Dropout
Pytorch implementation of Learning Rate Dropout.
Paper Link: https://arxiv.org/pdf/1912.00144.pdf
Train ResNet-34 for Cifar10:
run:
python main.py --model=resnet --optim=adam_lrd --lr=0.001 --LRD_p=0.5
python main.py --model=resnet --optim=adam --lr=0.001
python main.py --model=resnet --optim=sgd_lrd --lr=0.1 --LRD_p=0.5
python main.py --model=resnet --optim=sgd --lr=0.1
python main.py --model=resnet --optim=rmsprop_lrd --lr=0.001 --LRD_p=0.5
python main.py --model=resnet --optim=rmsprop --lr=0.001
After training, run "plot.py" to show the learning curves.
142 Dec 28, 2022
135 Dec 19, 2022
30 Jan 06, 2023
212 Dec 29, 2022
43 Dec 14, 2022
1.9k Dec 19, 2022
3 Mar 06, 2022
50 Nov 09, 2022
416 Jan 09, 2023
143 Jan 01, 2023
386 Jan 01, 2023
1.2k Jan 06, 2023
8 Dec 24, 2022
16 Sep 12, 2022
108 Dec 29, 2022
115 Jan 06, 2023
53 Sep 27, 2022
2 Oct 14, 2022
16 Dec 29, 2022