Glossary
LoRA (Low-Rank Adaptation)
A fine-tuning method that trains a small add-on instead of changing every weight in the model.
LoRA, short for low-rank adaptation, is a parameter-efficient fine-tuning method. It freezes the original model and trains small extra matrices that adjust its behavior, so fine-tuning needs far less memory and produces a small file you can swap in and out.
Because the base model stays untouched, you can keep one base model and several LoRA adapters, one per task or client. Variants such as QLoRA combine LoRA with a compressed base model to fit training on smaller hardware.
LoRA suits open-weight models you host yourself. It makes fine-tuning cheaper, but it does not remove the need for good training data and evaluation.
Start in 60 seconds
Put this to work on your project.
Get an AI-assisted, architect-reviewed scope, cost range, and timeline. Free, no login.