Glossary term
Glossary term
Infrastructure and Serving
A specific configuration of TPU devices in a Google data center. All of the devices in a TPU Pod are connected to one another over a dedicated high-speed network. A TPU Pod is the largest configuration of TPU devices available for a specific TPU version.
Created for this library
An ML platform team uses TPU pods to train its largest language model so the run completes within a day.
A research lab uses TPU pods for large-batch contrastive pretraining of vision-language models.
An ML platform team reserves TPU pods for production training jobs that require very large effective batch sizes.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License