Skip to content

npu: the decode lm head on the host, bit-identical logits — head time 51–78 ms → 8–18 ms per token on Qwen3.5-2B (opt-in, Refs #1785) - #2191

Merged
bong-water-water-bong merged 3 commits into
mainfrom
1bit/1785-host-head
Nov 11, 2026
Merged

bong-water-water-bong merged 3 commits into
mainfrom
1bit/1785-host-head

Merge branch 'main' into 1bit/1785-host-head

db41302
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (c-cpp)
succeeded Nov 11, 2026 in 1m 15s