Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions src/gpu/distill_specs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -324,6 +324,27 @@ ara-diac-tiny-max:
optimizer: muon
note: gapless 30M rung - full data + r7 + Muon + 6ep; the title
claim's decisive test
ara-diac-small-2-6ep-tashkeela:
# G2b: the domain-residual causal test (TODO.publish-client 01).
# Identical to the G2a recipe (r7 teacher, Muon, 6 epochs, vanilla
# ByT5-small) except the corpus: 144,662 units from the FULL cleaned
# Tashkeela corpus (~5x the r5-units corpus) — classical Arabic books
# + MSA. Gate: >= 0.5pp full-set DER improvement over G2a (4.5701)
# attributes the residual to domain coverage; flat reframes it.
teacher: rababa_arabic_byt5/run-007-news/best
teacher_volume: rababa
out_volume: rababa
student_init: google/byt5-small
train: tashkeela-units/train.txt
train_extra: []
unit_limits:
- 48000
max_len: 1450
label_beams: '1'
out: rababa_arabic_distill_small/run-011-tashkeela-6ep
mode: sequence
optimizer: muon
note: G2b label-scale rung; 5x corpus, same levers; gate vs 4.5701
ara-diac-tiny-stitched:
teacher: rababa_arabic_byt5/run-006-morph/best
teacher_volume: rababa
Expand Down
Loading