'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
-
Updated
Oct 10, 2023 - Python
#
self-knowledge-distillation
Here are 8 public repositories matching this topic...
[ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of some Self-Knowledge Distillation and data augmentation methods
-
Updated
Nov 28, 2022 - Python
The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://arxiv.org/abs/2412.08139
computer-vision imagenet image-classification coco object-detection cifar knowledge-distillation self-knowledge-distillation cross-architecture-knowledge-distillation neurips2024
-
Updated
Dec 13, 2024 - Python
The code for "Efficient-PrototypicalNet with self knowledge distillation for few-shot learning"
transfer-learning knowledge-distillation few-shot-learning prototypical-networks efficientnet few-shot-classification self-knowledge-distillation
-
Updated
Oct 8, 2024 - Python
PyTorch implementation of knowledge distillation with alternating loss functions for efficient deep learning model training.
machine-learning deep-learning pytorch neural-networks image-classification transfer-learning vgg16 knowledge-distillation loss-functions teacher-student cifar100 model-compression mobilenet self-knowledge-distillation alternating-loss-functions
-
Updated
Dec 29, 2024 - Jupyter Notebook
Knowledge Distillation research project that transfers knowledge from a VGG16 teacher model to a MobileNet student model using PyTorch and the CIFAR-100 dataset, exploring alternating loss functions to improve accuracy, reduce overfitting, and optimize model efficiency for resource-constrained devices.
python machine-learning computer-vision deep-learning pytorch neural-networks transfer-learning vgg16 knowledge-distillation loss-functions mobilenet cifar-100 model-optimization self-knowledge-distillation
-
Updated
Dec 26, 2024 - Jupyter Notebook
A deep learning research project exploring knowledge distillation with alternating loss functions to improve student model performance, reduce overfitting, and enhance training efficiency using PyTorch.
machine-learning computer-vision deep-learning pytorch neural-networks image-classification transfer-learning vgg16 knowledge-distillation teacher-student cifar100 mobilenet loss-function self-knowledge-distillation
-
Updated
Dec 29, 2024 - Jupyter Notebook
Semi-PKD: Semi-supervised Pseudoknowledge Distillation for saliency prediction
semi-supervised-learning unlabeled-data saliency-prediction self-knowledge-distillation ema-kd self-kd semi-pkd pseudoknowledge-distillation
-
Updated
Apr 12, 2025 - Python
Improve this page
Add a description, image, and links to the self-knowledge-distillation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the self-knowledge-distillation topic, visit your repo's landing page and select "manage topics."