Quantization - Four Bits and a Winter Coat
Cutting every weight from sixteen bits to four is nearly free. The handful of channels that shout a hundred times louder than the rest is what costs you.
GRPO and RLVR - The Answer Key and the Rank List
RLHF trained a model to mark the homework. RLVR checks the answer instead, and GRPO sacks the critic by grading every batch on a curve.
World Models - The Film Set That Never Runs Out of Street
Learned simulators generate the street instead of building it. Genie 3, Cosmos and GAIA-3 all look right, and looking right is the cheap part.
Speculative Decoding - Is Attention All You Really Need?
One token costs a full read of every weight in the model. Speculative decoding guesses eight, checks them in a single read, and changes nothing.
Solving Chess - Paths, Nodes and the Proof Nobody Has
Musk and Chess.com were counting different things. Solving chess was never about the tree's size, but about proving which branches you can skip.
LeJEPA - Good in Every Direction
Five years of self-supervised learning ran on superstition. LeJEPA replaces the EMA teacher, the stop-gradient and the rest with one provable term.
JEPA - Nobody Cares About the Wallpaper
On the cover: A police sketch in progress, drawn from a description rather than a photograph A witness sits down across the table. She was in the room. You want t...
VLAs - Pixels to Tokens
VLAs - Pixels to Actions On the cover: perception, solved. Grasping, still two euros a go. Moravec’s paradox in an arcade, and the reason the honest-cons section ...
VLMs - Pixels to Tokens
On the cover: Pieter Bruegel the Elder, “The Tower of Babel” (1563). Everyone on the site is competent and none of them are mutually intelligible, which is precis...
ViT - Pixels to Tokens
On the cover: “Blind monks examining an elephant” (Hanabusa Itchō, 1888). Each monk has hold of exactly one patch, and the animal only shows up once you combine t...
Cross Entropy Loss
On the cover: A weather forecasting stone meme Imagine you live, work and vacation in three different cities. In City A (home), it is sunny every single day. No c...
MoE - Is Attention All You Really Need?
On the cover: A bunch of different robots who are expert at different tasks It’s been 8 years since the landmark paper “Attention is all you need” was published. ...