From d19bec3c750a9d615bf944d8e7e75df03aeddcb2 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Tue, 1 Sep 2026 10:53:13 +0200 Subject: [PATCH] =?UTF-8?q?docs(EXPERIMENTS):=20head32=20flip-rate=20CIs?= =?UTF-8?q?=20=E2=80=94=20heb=20repair=20overwhelming,=20khm=20a=20proper?= =?UTF-8?q?=20null?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Paired bootstrap over per-pair position dumps (the new parity feature): heb-diac 10.985% -> 0.288% flips, delta -10.696pp, 95% CI [-11.661, -9.726]. khm-latn 2.325% -> 2.302%, CI [-0.173, +0.125] — statistically indistinct, exactly right for a family that was never broken. Probe-set note disclosed (full gate sets vs the original E1 golden subset). --- docs/EXPERIMENTS.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/EXPERIMENTS.md b/docs/EXPERIMENTS.md index b0096ea..c55949c 100644 --- a/docs/EXPERIMENTS.md +++ b/docs/EXPERIMENTS.md @@ -95,6 +95,16 @@ All rows passed the CER parity gate at release. Readings: profile; needed an fp32 export first (the volume had none — also fixed the plain-export entrypoint double-split en route, PR #109). All five head32 artifacts are gated and sitting on the volume. +- **Flip-rate CIs (2026-09-01, per-pair position dumps + paired + bootstrap, 10k resamples)**: heb-diac — the outlier family — + shipped 10.985% -> head32 0.288% flips, delta **-10.696pp, 95% CI + [-11.661, -9.726]**: the repair is overwhelming. khm-latn — a + benign family — 2.325% -> 2.302%, CI [-0.173, +0.125]: a proper + null, i.e. the rebuild changes nothing measurable where nothing + was broken (head32's role there is consistency, not repair). + Probe-set note: these use the full gate sets (1,864 / 895 pairs), + not the original E1 golden subset — the shipped-heb side therefore + reads 10.985% vs the table's 9.34%; same story, larger set. **Swap-in is a version decision**: (a) replace the shipped int8 zips in place + cut index-v2 (consumers re-download; sha pins change deliberately), or (b) publish as parallel `-int8-head32`