perf(executorch): opt-in shared per-device activation-scratch pool - #4600

Open

Conarnar wants to merge 10 commits into

pytorch:mainfrom

Conarnar:perf/executorch-shared-scratch-pool

Commits on Sep 1, 2026

perf(executorch): opt-in shared per-device activation-scratch pool
Conarnar
committed
6c8c12e
fix(executorch): make the scratch pool per device, fail an ambiguous zero-size query, cover the pooled path
Conarnar
committed
ba430a3

Commits on Sep 6, 2026

fix(executorch): hold the scratch pool's device lock across the enqueue
Conarnar
committed
a67cdf3
fix(executorch): unpublish the pool header and scope the growth claims
Conarnar
committed
8e774eb
fix(executorch): install the engine-wide activation scratch when the per-shape query answers zero
Conarnar
committed
45f9990
fix(executorch): stop a zero-scratch call sizing the pool for the whole profile
Conarnar
committed
f594f82
fix(executorch): refuse a pooled scratch install TensorRT rejected
Conarnar
committed
dfc97a2

Commits on Sep 7, 2026

Commits on Sep 8, 2026

fix(executorch): drain a failing call's host-input copy, queue a growth's free on its stream, unship the install helper
Conarnar
committed
45ea07c