Skip to content
#

sequence-level-kd

Here is 1 public repository matching this topic...

Sequence-level (hard) knowledge distillation of reasoning traces into small LLMs. Paired MATH-500 evaluation: the teacher's style decides the damage, not the student's size — the same 1.7B loses 3.4 points on a weak teacher's traces and 30.8 on a strong one's.

  • Updated Oct 12, 2026
  • Python

Add this topic to your repo

To associate your repository with the sequence-level-kd topic, visit your repo's landing page and select "manage topics."

Learn more