JOURNAL ARTICLE
ViTKD: Feature-based Knowledge Distillation for Vision Transformers
Keywords:
Computer science Distillation Transformer Artificial intelligence Feature extraction Pattern recognition (psychology) Engineering Electrical engineering Voltage Chemistry Chromatography
Metrics
13
Cited By
6.89
FWCI (Field Weighted Citation Impact)
47
Refs
0.95
Citation Normalized Percentile
Is in top 1%
Is in top 10%
Citation History
Topics
Advanced Neural Network Applications
Physical Sciences → Computer Science → Computer Vision and Pattern Recognition
Related Documents
JOURNAL ARTICLE
Cumulative Spatial Knowledge Distillation for Vision Transformers
Borui ZhaoRenjie SongJiajun Liang
Year: 2023 Pages: 6123-6132
BOOK-CHAPTER
Vision Transformers and CNN-Based Knowledge-Distillation for Histopathological Image Classification
Seddik BoudissaShyam Sundar DebsarkarHiroharu KawanakaBruce J. AronowV. B. Surya Prasath
Frontiers in artificial intelligence and applications Year: 2024
JOURNAL ARTICLE
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers
Xianing ChenQiong CaoYujie ZhongJing ZhangShenghua GaoDacheng Tao
Journal: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Year: 2022 Pages: 12042-12052
BOOK-CHAPTER
Class-Based Feature Knowledge Distillation
Khouloud SaadiJelena MitrovićMichael Granitzer
Machine translation Year: 2025 Pages: 119-130
BOOK-CHAPTER
Vision Transformers for Small Histological Datasets Learned Through Knowledge Distillation
Neel KanwalTrygve EftestølFarbod KhoraminiaTahlita C.M. ZuiverloonKjersti Engan
Lecture notes in computer science Year: 2023 Pages: 167-179