Skip to content

npu: a launch's result is dequantised with one multiply per element, not one ldexp(): prefill 24.4-25.1 -> 29.8-30.6 tok/s on the served 27B pack (Refs #1990) - #2008

Merged
bong-water-water-bong merged 1 commit into
mainfrom
cl-npuperf/1990-deq-out
Nov 10, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
cl-npuperf/1990-deq-out

npu: a launch's result is dequantised with one multiply per element, …

93d5843
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (c-cpp)
succeeded Nov 10, 2026 in 1m 31s