Category: Weekly Digest
Cross-topic weekly summaries of frontier AI research
-
Week 22, 2026 — LLM Training & Scaling Laws
This week brought transformative advances in understanding how large language models scale and train — from a unified theory of scaling failures to practical recipes for MoE hyperparameter transfer and data mixture auditing. Shannon Scaling Law Unifies Training Phenomena Xu Ouyang and colleagues proposed the Shannon Scaling Law, treating LLM training as information transmission over…