JOURNAL ARTICLE

Adaptive BPE Tokenization for Enhanced Vocabulary Adaptation in Finetuning Pretrained Language Models

Keywords:
Computer science Adaptation (eye) Vocabulary Lexical analysis Artificial intelligence Natural language processing Linguistics Psychology Neuroscience

Metrics

2
Cited By
1.28
FWCI (Field Weighted Citation Impact)
0
Refs
0.79
Citation Normalized Percentile
Is in top 1%
Is in top 10%

Citation History

Topics

Natural Language Processing Techniques
Physical Sciences →  Computer Science →  Artificial Intelligence
Topic Modeling
Physical Sciences →  Computer Science →  Artificial Intelligence
Text Readability and Simplification
Physical Sciences →  Computer Science →  Artificial Intelligence

Related Documents

JOURNAL ARTICLE

Sub-Character Tokenization for Chinese Pretrained Language Models

Chenglei SiZhengyan ZhangYingfa ChenFanchao QiXiaozhi WangZhiyuan LiuYasheng WangQun LiuMaosong Sun

Journal:   Transactions of the Association for Computational Linguistics Year: 2023 Vol: 11 Pages: 469-487
JOURNAL ARTICLE

Code-switching finetuning: Bridging multilingual pretrained language models for enhanced cross-lingual performance

Changtong ZanLiang DingLi ShenYu CaoWeifeng Liu

Journal:   Engineering Applications of Artificial Intelligence Year: 2024 Vol: 139 Pages: 109532-109532
JOURNAL ARTICLE

Geographic Adaptation of Pretrained Language Models

Valentin HofmannGoran GlavaššNikola LjubešićJanet B. PierrehumbertHinrich Schütze

Journal:   Transactions of the Association for Computational Linguistics Year: 2024 Vol: 12 Pages: 411-431
JOURNAL ARTICLE

Masking as an Efficient Alternative to Finetuning for Pretrained Language Models

Mengjie ZhaoTao LinFei MiMartin JaggiHinrich Schütze

Journal:   Open access LMU (Ludwid Maxmilian's Universitat Munchen) Year: 2020
© 2026 ScienceGate Book Chapters — All rights reserved.