Glossary term
Glossary term
Architecture
The number of neurons in a particular layer of a neural network.
Created for this library
A research team experiments with model width up to 4096 in its dense hidden layers to find the right capacity for its dataset.
An ML platform team caps model width on its on-device model to keep latency and memory within budget.
A startup picks model width to fit the inference budget rather than maximum accuracy because per-call cost dictates the production design.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License