Glossary term
Glossary term
Infrastructure and Serving
A configuration of one or more TPU devices with a specific TPU hardware version. You select a TPU type when you create a TPU node on Google Cloud. For example, a v2-8 TPU type is a single TPU v2 device with 8 cores. A v3-2048 TPU type has 256 networked TPU v3 devices and a total of 2048 cores. TPU types are a resource defined in the Cloud TPU API.
Created for this library
An ML platform team selects TPU types based on workload characteristics and cost targets for each model family.
A research engineer compares TPU types in benchmarks before committing to one for a long pretraining run.
An ML platform team standardizes TPU types per workload class so capacity planning stays simple.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License