Fine-tuning
Last Updated: July 29, 2026 | By Mihail Sebastian | AI Dictionary
Continued training of a pretrained model on a smaller task-specific dataset, so it keeps its general knowledge and gains specialized behavior.
What is Fine-Tuning?
Fine-tuning is the continued training of a pretrained model on a smaller, task-specific dataset, so the model keeps its general knowledge and gains specialized behavior. It is how general-purpose models become specialists: the same base model that writes poetry can be fine-tuned into a medical coder or a contract reviewer.
Training that specialist from scratch would take the task data plus the base model’s entire corpus. Fine-tuning needs only the task data.
How Fine-Tuning Works
Fine-tuning starts from the pretrained model’s weights and runs additional training passes over the new dataset, at a low learning rate so the new task refines the old knowledge instead of erasing it. Full fine-tuning updates every layer. Partial fine-tuning freezes the early layers, which hold general features, and trains only the later ones, which cuts compute and reduces overfitting on small datasets.
Parameter-efficient variants go further: they leave the original weights untouched and train a small set of added weights instead. That puts fine-tuning of large language models within reach of ordinary teams.
Fine-Tuning vs Transfer Learning
Fine-tuning is one specific way to do transfer learning: transfer learning names the general strategy of reusing knowledge across tasks, and fine-tuning is the technique of continuing training on the new task. Saying “we used transfer learning” describes the plan; saying “we fine-tuned BERT” describes the method.
| Fine-tuning | Transfer learning | |
|---|---|---|
| What it names | One specific technique | The broader strategy |
| What happens to the model | Weights update through further training | Knowledge is reused; weights may stay frozen |
| Starting point | Always a pretrained model | Any knowledge carried over from a source task |
| Example | Training BERT further on legal contracts | Reusing ImageNet features to read X-rays |
Example of Fine-Tuning
A software company wants a support assistant that knows its product. It collects several thousand past support tickets paired with the answers its best agents wrote.
The team fine-tunes a general language model on those pairs. The result answers in the company’s voice and knows the product’s quirks, because that knowledge now lives in the weights. For knowledge that changes weekly, such as pricing or release notes, RAG fits better: it fetches current documents at query time instead of freezing them into the model.
Related AI terms: Transfer Learning · Pretrained Model · Few-Shot Learning · RAG (Retrieval-Augmented Generation)
Did you like the Fine-tuning gist?
Learn about 250+ need-to-know artificial intelligence terms in the AI Dictionary.
Mihail Sebastian — Writes about AI governance, regulation, and the technology behind them. Placeholder bio — replace with a real credential line. About