Glossary term
Glossary term
Evaluation and Benchmarks
Overloaded term with the following meanings:
The standard meaning within software engineering. Namely: How fast (or efficiently) does this piece of software run?
The meaning within machine learning. Here, performance answers the following question: How correct is this model? That is, how good are the model's predictions?
Created for this library
An ML platform team tracks model performance on quality and operational metrics together so capacity and cost decisions match the business case.
A SaaS company sets a clear performance threshold per model so releases are only promoted if they meet the threshold.
An ML platform team reports performance trends across quarters so leadership can plan investment in compute and storage.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License