KV Caching & MLA - Is Attention All You Really Need?
On the cover: MLA Architecture. Credits: Welch Labs It’s been 8 years since the landmark paper “Attention is all you need” was published. The paper introduced the...
Markov Chain - The connection between Nuclear Bombs, Google Search, and Perplexity
On the cover: A Nuclear Bomb Explosion Recently I watched this video by Veritasium talking about Markov Chains. I really liked the examples he used to explain the...
HNSW - Finding Needles in Vector Haystacks
On the cover: HNSW graph depiction. Credits: Marqo Imagine a city with 10 million coffee shops. You (the customer) have a very specific taste vector: medium roast...
Padlocks to Prime Numbers - RSA Encryption and SSH
On the cover: RSA Encryption If you’ve ever shopped online, sent a private message, or connected to a secure website, you’ve probably used RSA encryption without ...
How can you cook your pasta fasta? :p
On the cover: A cute robot chef cooking pasta Concurrency in Python is like running a restaurant kitchen during a dinner rush - and if you’re making pasta, you’re...
LoRA - The Diet Pill for Obese Language Models
On the cover: The concept of low-rank adaptation visualized as dimension reduction If you’ve been paying any attention to the AI world lately, you might have noti...
Flux Models: The New Kid on the Generative Block - Part 2
On the cover: An AI-generated image showcasing the capabilities of Flux models In Part 1 of this series, we explored the basics of Flux models, their mathematical...
Flux Models: The New Kid on the Generative Block - Part 1
On the cover: An AI-generated image of flowing light streams representing the concept of Flux models Remember when we were all amazed by diffusion models like DAL...
RLHF: Teaching robots right and wrong
On the cover: Screenshot from the movie “Ron’s gone wrong” where a kid teaches his pet robot how to behave socially The term “RLHF” or Reinforcement Learning from...
ChatGPT - The Conversational Wizard
On the cover: ChatGPT’s response to the prompt “What is the meaning of life?” As the AI war between Google and Microsoft is brewing, it’s high time we understand ...
Guided Diffusion Models - Part 2
On the cover: Midjourney’s creation for the prompt “Sun Goddess artful” We saw how we could train a generative diffusion model in the previous post. But what fun ...
Guided Diffusion Models - Part 1
On the cover: Midjourney’s creation for the prompt “Astronauts exploring an alien red planet” Diffusion models are all the rage these days. Why do we need these n...