Repository navigation

hrx: keep routed-expert activations inside the f16 range, so a large SwiGLU output is not inf (engine #1539) - #284

Closed

bong-water-water-bong wants to merge 2 commits into

1bit/hrx-vulkan-patchedfrom

fix/1539-routed-matmul-f16-range

Closed

hrx: keep routed-expert activations inside the f16 range, so a large SwiGLU output is not inf (engine #1539)#284
bong-water-water-bong wants to merge 2 commits into
1bit/hrx-vulkan-patchedfrom
fix/1539-routed-matmul-f16-range

Commits on Nov 10, 2026
- hrx: keep routed-expert activations inside the f16 range, so a large SwiGLU output is not inf (engine #1539)
  
  bong-water-water-bong
  and
  claude
  committed
  fddb191
- tests: pin the lower edge of the routed-matmul f16 window too (review of #284)
  
  bong-water-water-bong
  and
  claude
  committed
  6a74ee8