Glossary term
Glossary term
Infrastructure and Serving
The total number of scalars a Tensor contains. For example, a [5, 10] Tensor has a size of 50.
Created for this library
An ML platform team monitors tensor size in its activation memory profile to fit large models on a given accelerator.
A research engineer logs tensor size across layers to identify activation memory hotspots during model design.
An ML platform team uses tensor size estimates when planning batch size for new accelerators.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License