Glossary term
Glossary term
Architecture
A language model that bases its probabilities only on the tokens appearing before, not after, the target token(s). Contrast with bidirectional language model.
Created for this library
A code-completion vendor uses a unidirectional language model so it can stream suggestions one token at a time in the IDE.
A speech synthesis startup uses a unidirectional language model so audio generation can start before the full sentence is processed.
A live-translation startup uses a unidirectional language model on the decoder so target tokens can be streamed during simultaneous interpretation.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License