Skip to content

npu: the decode lm head on the host by default, NPU_HEAD_HOST=0 for the device — logits byte-identical; window11 row set passes, prefill rows read faster (Refs #1785) - #2227

Merged
bong-water-water-bong merged 3 commits into
mainfrom
1bit/1785-head-host-default
Nov 12, 2026
Merged

npu: the decode lm head on the host by default, NPU_HEAD_HOST=0 for the device — logits byte-identical; window11 row set passes, prefill rows read faster (Refs #1785)#2227
bong-water-water-bong merged 3 commits into
mainfrom
1bit/1785-head-host-default

Merge branch 'main' into 1bit/1785-head-host-default

ad876fd
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (actions)
succeeded Nov 12, 2026 in 36s