Skip to content

Commit 5e225a1

Browse files
committed
Mention adabound in the readme
1 parent 011df9e commit 5e225a1

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

README.rst

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,9 @@ Supported Optimizers
3939
| `AccSGD`_ | https://arxiv.org/abs/1909.11015 |
4040
+-------------+-------------------------------------------------------------------------------+
4141
| | |
42+
| `AdaBound`_ | https://arxiv.org/abs/1902.09843 |
43+
+-------------+-------------------------------------------------------------------------------+
44+
| | |
4245
| `AdaMod`_ | https://arxiv.org/abs/1904.00962 |
4346
+-------------+-------------------------------------------------------------------------------+
4447
| | |
@@ -67,6 +70,14 @@ AccSGD
6770

6871
**Reference Code**: https://github.com/rahulkidambi/AccSGD
6972

73+
AdaBound
74+
--------
75+
.. image:: https://raw.githubusercontent.com/jettify/pytorch-optimizer/master/docs/rastrigin_AdaBound.png
76+
:alt: accsgd
77+
78+
**Paper**: *Adaptive Gradient Methods with Dynamic Bound of Learning Rate* (2019) [https://arxiv.org/abs/1902.09843]
79+
80+
**Reference Code**: https://github.com/Luolc/AdaBound
7081

7182
AdaMod
7283
------

0 commit comments

Comments
 (0)