Skip to content

docs: E6 verdict — gate FAILED at 5.8057; register-swap negative - #140

Merged
ronaldtse merged 1 commit into
mainfrom
docs/e6-verdict
Sep 2, 2026
Merged

docs: E6 verdict — gate FAILED at 5.8057; register-swap negative#140
ronaldtse merged 1 commit into
mainfrom
docs/e6-verdict

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

E6 (run-008-tashkeela-mix) verdict, from final_eval.json on the checkpoints volume:

  • student 5.8057 / teacher 2.289 full-set windowed DER (n=1200, teacher reproduces its documented 2.2864 — protocol consistent)
  • GATE FAILED (<=4.5218 required; control 4.8218; E5 failed at 5.0853) — NOT ADOPTED; registered prediction 4.45-4.75 missed
  • paired bootstrap student-teacher +3.2388pp, CI [2.939, 3.575]
  • Read: swapping news-domain units out for classical-register units at constant budget HURT (~1pp) — the news-domain teacher labels match the benchmark surface better than classical units do. With G2a (4.5701 at 6 epochs) the ladder reads: longer training and more total units move the rung; register swaps at constant budget do not. Direction shifts to G2b (48k add).

EXPERIMENTS.md E6 status + PUBLICATION-NOTES section-8 negatives (E5+E6 as the data-vs-architecture pair) + Paper-B paragraph. Labels sha256 pinned in the verdict entry.

…st is negative

Constant-budget diversification (8k news units swapped for classical
Tashkeela, 30k total, identical schedule) scored 5.8057 vs the 4.8218
control and gate 4.5218 — worse than E5. Teacher reproduced at 2.289
(n=1200). PUBLICATION-NOTES: E5+E6 recorded as the data-vs-
architecture negative pair; Paper-B paragraph updated (residual is
not fixed by register mix at constant budget; G2b add is the live
test).
@ronaldtse
ronaldtse merged commit 5745d80 into main Sep 2, 2026
11 checks passed
@ronaldtse
ronaldtse deleted the docs/e6-verdict branch September 2, 2026 16:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant