What is PEFT?
Fine-Tuning
PEFT (Parameter-Efficient Fine-Tuning) — A family of techniques that fine-tune only a small subset of model parameters instead of all weights. Includes LoRA, QLoRA, prefix tuning, and adapters. Reduces compute by 10-1000x.
FAQ
What is PEFT?
Parameter-Efficient Fine-Tuning — methods that train only a tiny fraction of model weights, making fine-tuning affordable.
Which PEFT method is best?
LoRA/QLoRA for most use cases. They offer the best quality-to-cost ratio.
Related Terms
Learn PEFT in depth
Free hands-on course with code examples and Google Colab notebooks.
Start Course →