Glossary term
Glossary term
Governance and Compliance
The tendency to search for, interpret, favor, and recall information in a way that confirms one's pre-existing beliefs or hypotheses. Machine learning developers may inadvertently collect or label data in ways that influence an outcome supporting their existing beliefs. Confirmation bias is a form of implicit bias.
Experimenter's bias is a form of confirmation bias in which an experimenter continues training models until a pre-existing hypothesis is confirmed.
Created for this library
A bank's model risk team includes confirmation bias in its review checklist so reviewers question whether they only sought evidence that the model is good.
A people-analytics team trains its analysts to challenge confirmation bias when interpreting hiring-model results that match existing beliefs.
A research team runs blinded evaluations of competing models to reduce confirmation bias from researchers who built one of the candidates.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License