Glossary term
Glossary term
Governance and Compliance
The structured handling of incidents, complaints, ambiguous outputs, or risk signals to determine severity, ownership, immediate actions, and escalation. AI triage requires criteria for sensitive harm, regulatory exposure, customer impact, security, and reputational risk so that minor issues do not crowd out severe ones.
NIST SP 800-61 Computer Security Incident Handling Guide provides triage principles applicable to AI incidents.
The FAIR Institute publishes guidance on quantitative risk triage applicable to AI security and operational incidents.
Major AI providers including OpenAI and Anthropic maintain trust and safety triage teams handling abuse reports, jailbreaks, and policy violations.