Skip to content

Make float16 actually work using gradient and optimizer state scaling - #15

Open
e-c-d wants to merge 4 commits into
warner-benjamin:mainfrom
e-c-d:feature/gradient-scaling
Open

Make float16 actually work using gradient and optimizer state scaling#15
e-c-d wants to merge 4 commits into
warner-benjamin:mainfrom
e-c-d:feature/gradient-scaling

Implement gradient scaling for Adan when using the triton backend. Te…

930b861
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs