• Depth 1 -- Understanding Pre-LN and Post-LN

  7 min read   ·   January 20, 2026

  2026   ·   Physics-of-AI   Depth     ·   AI  

• Bigram 3 -- Low Rank Structure

  4 min read   ·   January 19, 2026

  2026   ·   Physics-of-AI   Bigram   Toy-language     ·   AI  

• Bigram 2 -- Emergence of Hyperbolic Spaces

  9 min read   ·   January 16, 2026

  2026   ·   Physics-of-AI   Bigram   Toy-language     ·   AI  

• Bigram 1 -- Walk on a Circle

  6 min read   ·   January 15, 2026

  2026   ·   Physics-of-AI   Bigram   Toy-language     ·   AI  

• Diffusion 1 -- Sparse and Dense Neurons

  4 min read   ·   January 14, 2026

  2026   ·   Physics-of-AI   Diffusion     ·   AI