APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models

Qifan Wang; Yuning Mao; Jingang Wang; Hanchao Yu; Shaoliang Nie; Sinong Wang; Fuli Feng; Lifu Huang; Xiaojun Quan; Zenglin Xu; Dongfang Liu

doi:10.18653/v1/2023.emnlp-main.567

JOURNAL ARTICLE

APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models

Qifan Wang Yuning Mao Jingang Wang Hanchao Yu Shaoliang Nie Sinong Wang Fuli Feng Lifu Huang Xiaojun Quan Zenglin Xu Dongfang Liu

Year: 2023 Pages: 9147-9160

DOI: 10.18653/v1/2023.emnlp-main.567

Get Full-Text PDF Get Analytical Report

Abstract

Qifan Wang, Yuning Mao, Jingang Wang, Hanchao Yu, Shaoliang Nie, Sinong Wang, Fuli Feng, Lifu Huang, Xiaojun Quan, Zenglin Xu, Dongfang Liu. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

Keywords:

Adaptation (eye) Computer science Artificial intelligence Natural language processing Psychology Neuroscience

Metrics

Cited By

6.39

FWCI (Field Weighted Citation Impact)

Refs

0.96

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Topic Modeling

Physical Sciences → Computer Science → Artificial Intelligence

APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models

Abstract

Metrics

Citation History

Topics

Related Documents

Attention Prompt Tuning: Parameter-efficient Adaptation of Pre-trained Models for Action Recognition

Prompt Tuning for Discriminative Pre-trained Language Models

STP: Special token prompt for parameter-efficient tuning of pre-trained language models

CPT: Colorful Prompt Tuning for pre-trained vision-language models

Prompt Your Brain: Scaffold Prompt Tuning for Efficient Adaptation of fMRI Pre-trained Model