Glossary term
Glossary term
Foundations
A forward pass and backward pass of one batch.
See backpropagation for more information on the forward pass and backward pass.
Created for this library
An ML team measures training progress in steps rather than wall-clock time so comparisons are fair across hardware.
A research team configures learning rate decay on a per-step schedule for its largest training runs.
An ML platform team logs metrics every N steps to balance observability against logging overhead.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License