Glossary term
Glossary term
Architecture
A technique for automatically designing the architecture of a neural network. NAS algorithms can reduce the amount of time and resources required to train a neural network.
NAS typically uses:
A search space, which is a set of possible architectures.
A fitness function, which is a measure of how well a particular architecture performs on a given task.
NAS algorithms often start with a small set of possible architectures and gradually expand the search space as the algorithm learns more about what architectures are effective. The fitness function is typically based on the performance of the architecture on a training set, and the algorithm is typically trained using a reinforcement learning technique.
NAS algorithms have proven effective in finding high-performing architectures for a variety of tasks, including image classification, text classification, and machine translation.
Created for this library
An ML platform team uses neural architecture search to discover a small model that meets on-device latency targets.
A research team uses neural architecture search to explore architectures for a new domain when human intuition is limited.
A vendor uses neural architecture search to build a family of model sizes tuned to different cost-versus-quality points.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License