Collection by
Mar 9
Mar 9-
Attention Heads of Large Language Models: A Survey
Paper • 2409.03752 • Published • 92 -
Transformer Explainer: Interactive Learning of Text-Generative Models
Paper • 2408.04619 • Published • 172 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 151 -
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Paper • 2305.10429 • Published • 3
