File tree Expand file tree Collapse file tree 1 file changed +24
-0
lines changed
Expand file tree Collapse file tree 1 file changed +24
-0
lines changed Original file line number Diff line number Diff line change @@ -34,6 +34,30 @@ Installation process is simple, just::
3434Supported Optimizers
3535====================
3636
37+ +-------------+-------------------------------------------------------------------------------+
38+ | | |
39+ | `AccSGD `_ | https://arxiv.org/abs/1909.11015 |
40+ +-------------+-------------------------------------------------------------------------------+
41+ | | |
42+ | `AdaMod `_ | https://arxiv.org/abs/1904.00962 |
43+ +-------------+-------------------------------------------------------------------------------+
44+ | | |
45+ | `DiffGrad `_ | https://arxiv.org/abs/1909.11015 |
46+ +-------------+-------------------------------------------------------------------------------+
47+ | | |
48+ | `Lamb `_ | https://arxiv.org/abs/1904.00962 |
49+ +-------------+-------------------------------------------------------------------------------+
50+ | | |
51+ | `RAdam `_ | https://arxiv.org/abs/1908.03265 |
52+ +-------------+-------------------------------------------------------------------------------+
53+ | | |
54+ | `SGDW `_ | https://arxiv.org/abs/1904.00962 |
55+ +-------------+-------------------------------------------------------------------------------+
56+ | | |
57+ | `Yogi `_ | https://papers.nips.cc/paper/8186-adaptive-methods-for-nonconvex-optimization |
58+ +-------------+-------------------------------------------------------------------------------+
59+
60+
3761AccSGD
3862------
3963.. image :: https://raw.githubusercontent.com/jettify/pytorch-optimizer/master/docs/rastrigin_AccSGD.png
You can’t perform that action at this time.
0 commit comments