Glossary term
Glossary term
Infrastructure and Serving
An approach for storing data more efficiently.
Packed data stores data either by using a compressed format or in some other way that allows it to be accessed more efficiently. Packed data minimizes the amount of memory and computation required to access it, leading to faster training and more efficient model inference.
Packed data is often used with other techniques, such as data augmentation and regularization, further improving the performance of models.
Created for this library
An NLP team uses packed data to concatenate short sequences into fixed-length training inputs so the GPU is well utilized.
A speech recognition team uses packed audio sequences to keep accelerator utilization high during training on variable-length recordings.
An ML platform team adopts packed data as the default input format for short-sequence training jobs to reduce padding waste.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License