JOURNAL ARTICLE
Transforming decoder-only models into encoder-only models with improved understanding capabilities
Zixian HuangXinwei HuangAo WuXiaxia WangGong Cheng
Year: 2024 Journal: Knowledge-Based Systems Vol: 309 Pages: 112907-112907 Publisher: Elsevier BV
Keywords:
Encoder Computer science Operating system
Metrics
2
Cited By
1.28
FWCI (Field Weighted Citation Impact)
40
Refs
0.80
Citation Normalized Percentile
Is in top 1%
Is in top 10%
Citation History
Topics
Topic Modeling
Physical Sciences → Computer Science → Artificial Intelligence
Reinforcement Learning in Robotics
Physical Sciences → Computer Science → Artificial Intelligence
Explainable Artificial Intelligence (XAI)
Physical Sciences → Computer Science → Artificial Intelligence
Related Documents
JOURNAL ARTICLE
Comparative Analysis of Encoder-Only, Decoder-Only, and Encoder- Decoder Language Models
Year: 2024 Pages: 524-530
JOURNAL ARTICLE
Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning?
Muhammad QoribGeonsik MoonHwee Tou Ng
Year: 2024 Pages: 16339-16347
BOOK-CHAPTER
Assessing Logical Reasoning Capabilities of Encoder-Only Transformer Models
Paulo PirozelliMarcos M. JoséPaulo de Tarso P. FilhoAnarosa A. F. BrandãoFábio Gagliardi Cozman
Lecture notes in computer science Year: 2024 Pages: 29-46
BOOK-CHAPTER
Compare Encoder-Decoder, Encoder-Only, and Decoder-Only Architectures for Text Generation on Low-Resource Datasets
Pei-Xuan CaiYao-Chung FanFang−Yie Leu
Lecture notes in networks and systems Year: 2021 Pages: 216-225