• Physics 1 -- Attention can't exactly simulate uniform linear motion

  8 min read   ·   February 04, 2026

  2026   ·   Physics-of-AI   AI-for-Physics   Physics   World-model     ·   AI  

• Depth 4 -- Flat directions (in weight space) are high frequency modes (in function space)

  6 min read   ·   February 03, 2026

  2026   ·   Physics-of-AI   Depth     ·   AI  

• Depth 3 -- Fun facts about loss hessian eigenvalues

  5 min read   ·   February 02, 2026

  2026   ·   Physics-of-AI   Depth     ·   AI  

• Diffusion 2 -- Visualizing flow matching, temporal dynamics

  4 min read   ·   February 01, 2026

  2026   ·   Physics-of-AI   Diffusion     ·   AI  

• Sparse attention 7 -- Stack of causal attention creates implicit positional embedding, and explaning "Loss in the middle"

  5 min read   ·   January 31, 2026

  2026   ·   Physics-of-AI   Sparse-attention     ·   AI