LoRA - The Diet Pill for Obese Language Models
On the cover: The concept of low-rank adaptation visualized as dimension reduction If you’ve been paying any attention to the AI world lately, you might have noticed these large language models (LLMs) getting increasingly portly. GPT-4 is rumored...