KV Caching & MLA - Is Attention All You Really Need?

On the cover: MLA Architecture. Credits: Welch Labs It’s been 8 years since the landmark paper “Attention is all you need” was published. The paper introduced the...

Markov Chain - The connection between Nuclear Bombs, Google Search, and Perplexity

On the cover: A Nuclear Bomb Explosion Recently I watched this video by Veritasium talking about Markov Chains. I really liked the examples he used to explain the...

HNSW - Finding Needles in Vector Haystacks

On the cover: HNSW graph depiction. Credits: Marqo Imagine a city with 10 million coffee shops. You (the customer) have a very specific taste vector: medium roast...

Padlocks to Prime Numbers - RSA Encryption and SSH

On the cover: RSA Encryption If you’ve ever shopped online, sent a private message, or connected to a secure website, you’ve probably used RSA encryption without ...

How can you cook your pasta fasta? :p

On the cover: A cute robot chef cooking pasta Concurrency in Python is like running a restaurant kitchen during a dinner rush - and if you’re making pasta, you’re...

LoRA - The Diet Pill for Obese Language Models

On the cover: The concept of low-rank adaptation visualized as dimension reduction If you’ve been paying any attention to the AI world lately, you might have noti...

Flux Models: The New Kid on the Generative Block - Part 2

On the cover: An AI-generated image showcasing the capabilities of Flux models In Part 1 of this series, we explored the basics of Flux models, their mathematical...

Flux Models: The New Kid on the Generative Block - Part 1

On the cover: An AI-generated image of flowing light streams representing the concept of Flux models Remember when we were all amazed by diffusion models like DAL...

RLHF: Teaching robots right and wrong

On the cover: Screenshot from the movie “Ron’s gone wrong” where a kid teaches his pet robot how to behave socially The term “RLHF” or Reinforcement Learning from...

ChatGPT - The Conversational Wizard

On the cover: ChatGPT’s response to the prompt “What is the meaning of life?” As the AI war between Google and Microsoft is brewing, it’s high time we understand ...

Guided Diffusion Models - Part 2

On the cover: Midjourney’s creation for the prompt “Sun Goddess artful” We saw how we could train a generative diffusion model in the previous post. But what fun ...

Guided Diffusion Models - Part 1

On the cover: Midjourney’s creation for the prompt “Astronauts exploring an alien red planet” Diffusion models are all the rage these days. Why do we need these n...