File tree Expand file tree Collapse file tree 1 file changed +11
-0
lines changed
Expand file tree Collapse file tree 1 file changed +11
-0
lines changed Original file line number Diff line number Diff line change @@ -39,6 +39,9 @@ Supported Optimizers
3939| `AccSGD `_ | https://arxiv.org/abs/1909.11015 |
4040+-------------+-------------------------------------------------------------------------------+
4141| | |
42+ | `AdaBound `_ | https://arxiv.org/abs/1902.09843 |
43+ +-------------+-------------------------------------------------------------------------------+
44+ | | |
4245| `AdaMod `_ | https://arxiv.org/abs/1904.00962 |
4346+-------------+-------------------------------------------------------------------------------+
4447| | |
@@ -67,6 +70,14 @@ AccSGD
6770
6871**Reference Code **: https://github.com/rahulkidambi/AccSGD
6972
73+ AdaBound
74+ --------
75+ .. image :: https://raw.githubusercontent.com/jettify/pytorch-optimizer/master/docs/rastrigin_AdaBound.png
76+ :alt: accsgd
77+
78+ **Paper **: *Adaptive Gradient Methods with Dynamic Bound of Learning Rate * (2019) [https://arxiv.org/abs/1902.09843]
79+
80+ **Reference Code **: https://github.com/Luolc/AdaBound
7081
7182AdaMod
7283------
You can’t perform that action at this time.
0 commit comments