PyTorch implementation of knowledge distillation with alternating loss functions for efficient deep learning model training.
machine-learning deep-learning pytorch neural-networks image-classification transfer-learning vgg16 knowledge-distillation loss-functions teacher-student cifar100 model-compression mobilenet self-knowledge-distillation alternating-loss-functions
-
Updated
Dec 29, 2024 - Jupyter Notebook