The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models

Adithya Bhaskar; Dan Friedman; Danqi Chen

doi:10.18653/v1/2024.acl-long.774

ScienceGate Book Chapters

JOURNAL ARTICLE

The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models

Adithya Bhaskar Dan Friedman Danqi Chen

Year: 2024 Pages: 14351-14368

DOI: 10.18653/v1/2024.acl-long.774

Get Full-Text PDF Get Analytical Report

Keywords:

Subnetwork Computer science Generalization Heuristic Core (optical fiber) Artificial intelligence Language model Natural language processing Machine learning Mathematics Computer security

Metrics

Cited By

0.64

FWCI (Field Weighted Citation Impact)

Refs

0.69

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Natural Language Processing Techniques

Physical Sciences → Computer Science → Artificial Intelligence

Topic Modeling

Physical Sciences → Computer Science → Artificial Intelligence

Speech and dialogue systems

Physical Sciences → Computer Science → Artificial Intelligence

The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models

Metrics

Citation History

Topics

Related Documents

Improving Generalization of Pretrained Language Models

Generalization and Fairness Optimization in Pretrained Language Models

Sparsity-Driven Generalization Enhancements in Compressed Pretrained Language Models

Pretrained Language Models for Biological Sequence Understanding

AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models