• Bigram 1 -- Walk on a Circle

  6 min read   ·   January 15, 2026

  2026   ·   Physics-of-AI     ·   AI  

• Diffusion 1 -- Sparse and Dense Neurons

  4 min read   ·   January 14, 2026

  2026   ·   Physics-of-AI     ·   AI  

• Sparse attention 4 -- previous token head

  7 min read   ·   January 13, 2026

  2026   ·   Physics-of-AI     ·   AI  

• Sparse attention 3 -- inefficiency of extracting similar content

  5 min read   ·   January 12, 2026

  2026   ·   Physics-of-AI     ·   AI  

• Emergence of Induction Head Depends on Learning Rate Schedule

  8 min read   ·   January 11, 2026

  2026   ·   Physics-of-AI     ·   AI