Skip to content

npu: a 17..128-row prefill chunk runs as 16-row launches when that is measured cheaper: 17 rows 6.95 s -> 1.94 s (fixes #1959) - #1963

Merged
bong-water-water-bong merged 8 commits into
mainfrom
cl-npuperf/prefill-narrow-split
Nov 12, 2026
Merged

bong-water-water-bong merged 8 commits into
mainfrom
cl-npuperf/prefill-narrow-split

Merge branch 'main' into cl-npuperf/prefill-narrow-split

628956e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Analyze (python)
succeeded Nov 12, 2026 in 1m 5s