Glossary term
Glossary term
Infrastructure and Serving
A TensorFlow Operation that implements a queue data structure. Typically used in I/O.
R
Created for this library
An ML engineer uses a prefetch queue in the input pipeline so the GPU is not stalled waiting for data.
A speech recognition team uses an input queue to overlap audio decoding with model computation during training.
An ML platform team monitors queue depths in its serving stack to detect upstream slowness before it impacts production.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License