Articles
Attention sinks in LLMs
The attention mechanism has a small flaw that recent models fix with one extra token.
What I learned this week 2026/35
The Gordian Knot was also untied and you can print your own magazine.
What I learned this week 2026/34
Nautical miles and Earth's size, filmmaking is cooperative, Pixar's story, everything is a YouTube video, and AI is used for low-priority work.
Exponential growth
Exponential growth looks flat for a long time and then suddenly takes off.