Layerwised multimodal knowledge distillation for vision-language pretrained model

Jin Wang; Dawei Liao; You Zhang; Dan Xu; Xuejie Zhang

doi:10.1016/j.neunet.2024.106272

ScienceGate Book Chapters

JOURNAL ARTICLE

Layerwised multimodal knowledge distillation for vision-language pretrained model

Jin Wang Dawei Liao You Zhang Dan Xu Xuejie Zhang

Year: 2024 Journal: Neural Networks Vol: 175 Pages: 106272-106272 Publisher: Elsevier BV

DOI: 10.1016/j.neunet.2024.106272

Get Full-Text PDF Get Analytical Report

Keywords:

Computer science Distillation Modalities Artificial intelligence Modality (human–computer interaction) Overfitting Machine learning Language model Transformer Artificial neural network

Metrics

Cited By

5.83

FWCI (Field Weighted Citation Impact)

Refs

0.93

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Multimodal Machine Learning Applications

Physical Sciences → Computer Science → Computer Vision and Pattern Recognition

Domain Adaptation and Few-Shot Learning

Physical Sciences → Computer Science → Artificial Intelligence

Topic Modeling

Physical Sciences → Computer Science → Artificial Intelligence

Layerwised multimodal knowledge distillation for vision-language pretrained model

Metrics

Citation History

Topics

Related Documents

Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation

Modality-specific Knowledge Distillation with Wasserstein Distance Minimization for Vision-Language Pretrained Models

Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model

Parameter-efficient online knowledge distillation for pretrained language models

Cross-Lingual Adaptation for Vision-Language Model via Multimodal Semantic Distillation