Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning?

Muhammad Qorib; Geonsik Moon; Hwee Tou Ng

doi:10.18653/v1/2024.findings-acl.967

ScienceGate Book Chapters

JOURNAL ARTICLE

Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning?

Muhammad Qorib Geonsik Moon Hwee Tou Ng

Year: 2024 Pages: 16339-16347

DOI: 10.18653/v1/2024.findings-acl.967

Get Full-Text PDF Get Analytical Report

Keywords:

Computer science Meaning (existential) Word (group theory) Encoder Language model Natural language processing Linguistics Artificial intelligence Speech recognition Psychology Philosophy

Metrics

Cited By

3.83

FWCI (Field Weighted Citation Impact)

Refs

0.91

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Natural Language Processing Techniques

Physical Sciences → Computer Science → Artificial Intelligence

Text Readability and Simplification

Physical Sciences → Computer Science → Artificial Intelligence

Topic Modeling

Physical Sciences → Computer Science → Artificial Intelligence

Are Decoder-Only Language Models Better than Encoder-Only Language Models in Understanding Word Meaning?

Metrics

Citation History

Topics

Related Documents

Comparative Analysis of Encoder-Only, Decoder-Only, and Encoder- Decoder Language Models

Transforming decoder-only models into encoder-only models with improved understanding capabilities

Sinhala Encoder-only Language Models and Evaluation

You Only Cache Once: Decoder-Decoder Architectures for Language Models

PrAd: Prompt Adaptive Tuning for Decoder-only Language Models