decoupled-knowledge-distillation

Here are 3 public repositories matching this topic...

ZaberKo / GDKD

Official PyTorch implementation of GDKD (IEEE TNNLS 2026) for CNN image classification. Rethinking Decoupled Knowledge Distillation from a Predictive Distribution Perspective.

machine-learning computer-vision deep-learning pytorch neural-networks imagenet image-classification transfer-learning knowledge-distillation model-compression cifar-100 tnnls dkd logit-distillation gdkd decoupled-knowledge-distillation

Updated Sep 14, 2026
Python

ZaberKo / vit-gdkd

Star

Official PyTorch implementation of GDKD (IEEE TNNLS 2026) for ViT image classification. Rethinking Decoupled Knowledge Distillation from a Predictive Distribution Perspective.

machine-learning computer-vision deep-learning pytorch neural-networks imagenet image-classification vit knowledge-distillation model-compression tnnls dkd vision-transformer logit-distillation gdkd decoupled-knowledge-distillation

Updated Sep 14, 2026
Python

ZaberKo / seg-gdkd

Star

Official PyTorch implementation of GDKD (IEEE TNNLS 2026) for semantic segmentation on Cityscapes. Rethinking Decoupled Knowledge Distillation from a Predictive Distribution Perspective.

machine-learning computer-vision deep-learning pytorch neural-networks semantic-segmentation knowledge-distillation cityscapes model-compression pspnet deeplabv3 tnnls dkd logit-distillation gdkd decoupled-knowledge-distillation

Updated Sep 14, 2026
Python

Add this topic to your repo

To associate your repository with the decoupled-knowledge-distillation topic, visit your repo's landing page and select "manage topics."

Learn more