Attention and feature transfer based knowledge distillation

Guoliang Yang; Shuaiying Yu; Yangyang Sheng; Hao Yang

doi:10.1038/s41598-023-43986-y

ScienceGate Book Chapters

JOURNAL ARTICLE

Attention and feature transfer based knowledge distillation

Guoliang Yang Shuaiying Yu Yangyang Sheng Hao Yang

Year: 2023 Journal: Scientific Reports Vol: 13 (1)Pages: 18369-18369 Publisher: Nature Portfolio

DOI: 10.1038/s41598-023-43986-y

Get Full-Text PDF Get Analytical Report

Keywords:

Computer science Inference Feature (linguistics) Benchmark (surveying) Artificial intelligence Block (permutation group theory) Knowledge transfer Machine learning Process (computing) Distillation Artificial neural network Knowledge management Mathematics

Metrics

Cited By

2.00

FWCI (Field Weighted Citation Impact)

Refs

0.84

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Advanced Neural Network Applications

Physical Sciences → Computer Science → Computer Vision and Pattern Recognition

Domain Adaptation and Few-Shot Learning

Physical Sciences → Computer Science → Artificial Intelligence

Machine Learning and ELM

Physical Sciences → Computer Science → Artificial Intelligence

Attention and feature transfer based knowledge distillation

Metrics

Citation History

Topics

Related Documents

Class Attention Transfer Based Knowledge Distillation

Knowledge Distillation With Feature Self Attention

Attention-based Feature Interaction for Efficient Online Knowledge Distillation

Artistic Style Transfer Based on Attention with Knowledge Distillation

Hierarchical Multi-Attention Transfer for Knowledge Distillation