Early Stopping
Last Updated: July 29, 2026 | By Mihail Sebastian | AI Dictionary
A training technique that halts a model once its error on held-out validation data stops improving, ending training before overfitting takes hold.
What is Early Stopping?
Early stopping is a training technique that halts a model once its error on a held-out validation set stops improving, ending training before overfitting takes hold. It treats training time itself as a dial for model complexity.
Among the remedies for overfitting it is the cheapest. Nothing about the model or its loss function changes; training simply ends at the right moment, which also saves compute.
How Early Stopping Works
After each epoch, training error and validation error are both measured. Training error keeps falling as long as training continues, because the model keeps fitting its own data ever more closely. Validation error falls only while the model is learning real patterns, then turns upward once it starts fitting noise.
That turning point is the signal. A patience parameter sets how many epochs without validation improvement to tolerate before stopping, so a brief plateau or a noisy epoch does not end training prematurely. When training stops, the weights are rolled back to the epoch with the best validation score.
Early stopping is a form of regularization: fewer updates leave less opportunity to encode noise. It works anywhere training is iterative, from neural networks to gradient-boosted trees such as XGBoost, where it caps how many trees get added.
Example of Early Stopping
A team trains an image classifier with a budget of 100 epochs and a patience of 5. Validation loss falls steadily and bottoms out at epoch 32. Over epochs 33 through 37 it creeps upward while training loss keeps improving – the model is now memorizing its training images.
Five epochs without a new best exhausts the patience, so training stops at epoch 37 and the weights revert to their epoch-32 state. The team ships the epoch-32 model and skips 63 epochs of compute that would only have made generalization worse.
Related AI terms: Overfitting · Regularization · Learning Curve · Validation Set · Epoch
Did you like the Early Stopping gist?
Learn about 250+ need-to-know artificial intelligence terms in the AI Dictionary.
Mihail Sebastian — Writes about AI governance, regulation, and the technology behind them. Placeholder bio — replace with a real credential line. About