Skip to content

[None][chore] Remove the Python KV bounce buffer; kv_cache_bounce_size_mb selects the C++ agent bounce - #20049

Open
chuangz0 wants to merge 10 commits into
NVIDIA:mainfrom
chuangz0:remove_python_bounce_buffer
Open

chuangz0 wants to merge 10 commits into
NVIDIA:mainfrom
chuangz0:remove_python_bounce_buffer

[None][test] Cover pipelined KV transfer through the C++ agent bounce

f48e5f1
Select commit
Loading
Failed to load commit list.