PEFT
TrainingParameter-Efficient Fine-Tuning. Family of techniques that train a small fraction of the model's parameters (LoRA, adapters, learnable prompts) instead of all weights, cutting training memory and time.
Parameter-Efficient Fine-Tuning. Family of techniques that train a small fraction of the model's parameters (LoRA, adapters, learnable prompts) instead of all weights, cutting training memory and time.