Glossary term
Glossary term
Training and Fine-Tuning
Synonym for learning rate.
Created for this library
An ML team uses an adaptive step size in Adam so different parameters effectively get different learning rates.
A research team tunes step size as the most impactful hyperparameter in its training pipeline before tuning batch size.
An ML platform team standardizes step-size schedules per model family so engineers can focus on data and features.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License