Glossary term
Glossary term
Training and Fine-Tuning
Synonym for softmax.
Contrast with candidate sampling.
See Neural networks: Multi-class classification in Machine Learning Crash Course for more information.
Created for this library
A small classification team uses full softmax over a few hundred classes because the cost is negligible at that scale.
A retail demand team uses full softmax over the category dimension because the number of categories is small.
An NLP team uses full softmax during evaluation but switches to sampled softmax during training to handle a large vocabulary.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License