LLM Fine-Tuning — LoRA, QLoRA, PEFT, Instruction Tuning, RLHF, DPO, Evaluation

LoRA, QLoRA, PEFT, RLHF, DPO

Author: AI Learning Club Team · Difficulty: Advanced · Duration: 1 hr 55 min · Modules: 22

Modules

1. Introduction to LLM Fine-Tuning (5 min)
2. Understanding LoRA (5 min)
3. Implementing LoRA in Practice (5 min)
4. Introduction to QLoRA (5 min)
5. Applying QLoRA Techniques (5 min)
6. Overview of PEFT (5 min)
7. Hands-On with PEFT (5 min)
8. Fundamentals of Instruction Tuning (5 min)
9. Advanced Instruction Tuning Strategies (5 min)
10. Introduction to RLHF (5 min)
11. Implementing RLHF (5 min)
12. Deep Dive into DPO (5 min)
13. Practical Applications of DPO (5 min)
14. Evaluation Metrics for Fine-Tuned LLMs (5 min)
15. Benchmarking Fine-Tuned Models (5 min)
16. Case Studies in LLM Fine-Tuning (5 min)
17. Ethical Considerations in Fine-Tuning (5 min)
18. Future Directions in LLM Fine-Tuning (5 min)
19. Project: Fine-Tuning a Small LLM (5 min)
20. Project: Evaluating a Fine-Tuned Model (5 min)
21. Capstone Project: Comprehensive LLM Fine-Tuning (5 min)
22. Resources & References (2 min)

Frequently Asked Questions

Related Courses

• MLOps & Model Deployment — Advanced
• Local LLM Architecture — Advanced
• Quantization Engineering — Advanced
• Production Inference — Advanced

← All courses