• Drifting VQ-VAE -- How "drifting models" fixe failure modes of VQ-VAE

  6 min read   ·   March 04, 2026

  2026   ·   Physics-of-AI   Representation   Diffusion     ·   AI  

• Loss landscape visualization 1 -- Seeing sticky plateau

  5 min read   ·   March 03, 2026

  2026   ·   Physics-of-AI   Loss-landscape     ·   AI  

• Research agent 1 -- Reproducing 2026-01-01 blog (physics of feature learning)

  6 min read   ·   February 28, 2026

  2026   ·   Physics-of-AI   Research-agent     ·   AI  

• Research agents should target knowledge graphs, not papers

  6 min read   ·   February 25, 2026

  2026   ·   Physics-of-AI   Methodology   Research-agent     ·   AI  

• 181-parameter transformer-like models for 10-digit addition

  5 min read   ·   February 24, 2026

  2026   ·   Physics-of-AI   Toy-language   Sparse-attention     ·   AI