Skip to content

hrx: keep routed-expert activations inside the f16 range, so a large SwiGLU output is not inf (engine #1539) - #284

Closed
bong-water-water-bong wants to merge 2 commits into
1bit/hrx-vulkan-patchedfrom
fix/1539-routed-matmul-f16-range
Closed

bong-water-water-bong wants to merge 2 commits into
1bit/hrx-vulkan-patchedfrom
fix/1539-routed-matmul-f16-range

Enhance your code review process with GitHub Actions

GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.

Linux, macOS, Windows, and containers
Linux, macOS, Windows, and containers
Matrix builds
Matrix builds
Any language
Any language
Live logs
Live logs
Built-in secret store
Built-in secret store
Multi-container testing
Multi-container testing