JOURNAL ARTICLE
Knowledge distillation for BERT unsupervised domain adaptation
Minho RyuGeonseok LeeKichun Lee
Year: 2022 Journal: Knowledge and Information Systems Vol: 64 (11)Pages: 3113-3128 Publisher: Springer Science+Business Media
Keywords:
Computer science Discriminative model Artificial intelligence Domain adaptation Distillation Machine learning Domain (mathematical analysis) Adaptation (eye) Language model Natural language processing Task (project management) Adversarial system Labeled data Pattern recognition (psychology) Classifier (UML) Mathematics
Metrics
33
Cited By
6.07
FWCI (Field Weighted Citation Impact)
34
Refs
0.95
Citation Normalized Percentile
Is in top 1%
Is in top 10%
Citation History
Topics
Topic Modeling
Physical Sciences → Computer Science → Artificial Intelligence
Natural Language Processing Techniques
Physical Sciences → Computer Science → Artificial Intelligence
Domain Adaptation and Few-Shot Learning
Physical Sciences → Computer Science → Artificial Intelligence
Related Documents
JOURNAL ARTICLE
Knowledge Distillation with Source-free Unsupervised Domain Adaptation for BERT Model Compression
Jing TianJuan ChenNing Jiang ChenLin BaiSuqun Huang
Year: 2023 Pages: 1766-1771
JOURNAL ARTICLE
Joint progressive knowledge distillation and unsupervised domain adaptation
Le Thanh Nguyen-MeidineÉric GrangerMadhu KiranJosé DolzLouis-Antoine Blais-Morin
Journal: Espace ÉTS (ETS) Year: 2020
JOURNAL ARTICLE
An Unsupervised Federated Domain Adaptation Method Based on Knowledge Distillation
Yunpeng XiaoYing GuoHaipeng ZhuChaolong JiaQian LiRong WangGuoyin Wang
Journal: IEEE Transactions on Neural Networks and Learning Systems Year: 2024 Vol: 36 (6)Pages: 10993-11007
JOURNAL ARTICLE
Bilateral Knowledge Distillation for Unsupervised Domain Adaptation of Semantic Segmentation
Journal: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Year: 2022 Pages: 10177-10184