Skip to content

Implement gradient pre-normalization in LAMB optimizer#415

Open
jglaser wants to merge 1 commit intojettify:masterfrom
jglaser:prenormalization
Open

Implement gradient pre-normalization in LAMB optimizer#415
jglaser wants to merge 1 commit intojettify:masterfrom
jglaser:prenormalization

Commits

Commits on Jan 11, 2022