Glossary term
Glossary term
Architecture
The portion of a Long Short-Term Memory cell that regulates the flow of information through the cell. Forget gates maintain context by deciding which information to discard from the cell state.
Created for this library
An NLP research team explains the forget gate in an LSTM to its new engineers as the mechanism that decides which past information to discard.
A speech recognition team inspects forget gate activations in an LSTM to understand how long the model retains acoustic context.
A time-series forecasting team analyzes forget gate values to confirm the model is discarding stale signal when traffic shifts at the end of a season.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License