LoRA - The Diet Pill for Obese Language Models
On the cover: The concept of low-rank adaptation visualized as dimension reduction If you’ve been paying any attention to the AI world lately, you might have noticed these large language models (LLMs) getting increasingly heavy and fat. GPT-4 is ...