Skip to content

Commit 011df9e

Browse files
committed
Add supported list of optimizers
1 parent 22250a3 commit 011df9e

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

README.rst

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,30 @@ Installation process is simple, just::
3434
Supported Optimizers
3535
====================
3636

37+
+-------------+-------------------------------------------------------------------------------+
38+
| | |
39+
| `AccSGD`_ | https://arxiv.org/abs/1909.11015 |
40+
+-------------+-------------------------------------------------------------------------------+
41+
| | |
42+
| `AdaMod`_ | https://arxiv.org/abs/1904.00962 |
43+
+-------------+-------------------------------------------------------------------------------+
44+
| | |
45+
| `DiffGrad`_ | https://arxiv.org/abs/1909.11015 |
46+
+-------------+-------------------------------------------------------------------------------+
47+
| | |
48+
| `Lamb`_ | https://arxiv.org/abs/1904.00962 |
49+
+-------------+-------------------------------------------------------------------------------+
50+
| | |
51+
| `RAdam`_ | https://arxiv.org/abs/1908.03265 |
52+
+-------------+-------------------------------------------------------------------------------+
53+
| | |
54+
| `SGDW`_ | https://arxiv.org/abs/1904.00962 |
55+
+-------------+-------------------------------------------------------------------------------+
56+
| | |
57+
| `Yogi`_ | https://papers.nips.cc/paper/8186-adaptive-methods-for-nonconvex-optimization |
58+
+-------------+-------------------------------------------------------------------------------+
59+
60+
3761
AccSGD
3862
------
3963
.. image:: https://raw.githubusercontent.com/jettify/pytorch-optimizer/master/docs/rastrigin_AccSGD.png

0 commit comments

Comments
 (0)