Glossary term
Glossary term
Agentic Systems
A system that is not guaranteed to return the same output for a given input. LLMs are generally nondeterministic; that is, LLMs typically generate different responses to the same prompt.
Nondeterministic systems are generally much harder to test than deterministic systems.
See also probabilistic.
Created for this library
An LLM team marks its assistant as nondeterministic by default and freezes seeds only for reproducibility evaluation.
A research team flags certain GPU kernels as nondeterministic and accepts that strict reproducibility requires switching to slower deterministic kernels.
An ML platform team documents which steps in its pipeline are nondeterministic so reviewers understand which results are exactly reproducible.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License