Prune Once for All: Sparse Pre-Trained Language Models

Ofir Zafrir; Ariel Larey; Guy Boudoukh; Haihao Shen; Moshe Wasserblat

doi:10.5281/zenodo.6967409

ScienceGate Book Chapters

JOURNAL ARTICLE

Prune Once for All: Sparse Pre-Trained Language Models

Ofir Zafrir Ariel Larey Guy Boudoukh Haihao Shen Moshe Wasserblat

Year: 2021 Journal: Zenodo (CERN European Organization for Nuclear Research) Publisher: European Organization for Nuclear Research

DOI: 10.5281/zenodo.6967409

Get Full-Text PDF Get Analytical Report

Abstract

@article{zafrir2021prune, title={Prune Once for All: Sparse Pre-Trained Language Models}, author={Zafrir, Ofir and Larey, Ariel and Boudoukh, Guy and Shen, Haihao and Wasserblat, Moshe}, journal={arXiv preprint arXiv:2111.05754}, year={2021} }

Keywords:

Computer science Natural language processing Artificial intelligence

Metrics

Cited By

0.00

FWCI (Field Weighted Citation Impact)

Refs

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Topics

Topic Modeling

Physical Sciences → Computer Science → Artificial Intelligence

Natural Language Processing Techniques

Physical Sciences → Computer Science → Artificial Intelligence

Speech Recognition and Synthesis

Physical Sciences → Computer Science → Artificial Intelligence

Prune Once for All: Sparse Pre-Trained Language Models

Abstract

Metrics

Topics

Related Documents

MediSwift: Efficient Sparse Pre-trained Biomedical Language Models

Sparse Low-rank Adaptation of Pre-trained Language Models

Pre-trained Language Models

Pre-trained Language Models

Improving Pre-trained Language Models