npu: set_layer_taps(), the target's hidden states at chosen layers for a draft that reads them (refs #1780) - #2180

npu: set_layer_taps(), the target's hidden states at chosen layers for a draft that reads them (refs #1780)#2180

bong-water-water-bong merged 3 commits into

main1bit-MONSTER/engine:mainfrom

cl-npuperf/1780-layer-taps1bit-MONSTER/engine:cl-npuperf/1780-layer-tapsCopy head branch name to clipboard