ScienceGate Book Chapters

JOURNAL ARTICLE

DAPE: Data-Adaptive Positional Encoding for Length Extrapolation

Yihang Gao Minbin Huang Xin Jiang Jingyao Li Yu Li Zhenguo Li Michael K. Ng Xiaozhe Ren Han Shi Jing Xiong Chuanyang Zheng

Year: 2024 Pages: 26659-26700

DOI: 10.52202/079017-0838

Get Full-Text PDF Get Analytical Report

Keywords:

Metrics

0

Cited By

0.00

FWCI (Field Weighted Citation Impact)

0

Refs

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Topics

Related Documents

JOURNAL ARTICLE

Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding

Liang Zhao Xiachong Feng Xiaocheng Feng Weihong Zhong Dongliang Xu Qing Yang Hongtao Liu Bing Qin Tianxiang Liu

Year: 2024 Pages: 9959-9977

JOURNAL ARTICLE

DAPE-BR: Distance-Aware Positional Encoding for Mitigating Object Hallucination in LVLMs

Mingrui Xie Tianxiang Xu Q.W Tang Sicong Yao Xiaofeng Zhang Junliang Du

Year: 2025 Pages: 8638-8649

JOURNAL ARTICLE

DAPE V2: Process Attention Score as Feature Map for Length Extrapolation

Chuanyang Zheng Yihang Gao Han Shi Jing Xiong Jiankai Sun Jingyao Li Minbin Huang Xiaozhe Ren Michael K. Ng Xin Jiang Zhenguo Li Yu Li

Year: 2025 Pages: 10628-10666

BOOK-CHAPTER

ADAPTIVE RUN-LENGTH ENCODING

Andrew Glassner

Elsevier eBooks Year: 1991 Pages: 89-92

JOURNAL ARTICLE

Attention Alignment and Flexible Positional Embeddings Improve Transformer Length Extrapolation

Ta-Chung Chi Ting-Han Fan Alexander I. Rudnicky

Year: 2024 Pages: 132-148