Case Study: AI in Healthcare Triage

Scenario

A hospital deploys an AI triage assistant that influences urgency ranking and care recommendations.

Proposed Tier

Tier 2 (high-impact societal).

Applicable Standards

• Transparency: 02_ai_standards/transparency_and_explainability.md
• Fairness: 02_ai_standards/fairness_and_justice.md
• Healthcare: 02_ai_standards/healthcare_ai.md
• Safety: 02_ai_standards/safety.md
• Accountability: 02_ai_standards/accountability.md
• Consultation: 01_governance/consultation_framework.md
• Audit: 05_audit_and_assurance/audit_methods.md

Key Risks

• disparate impact across demographic groups
• automation bias affecting clinician judgment
• unsafe recommendations under distribution shift

Required Evidence Artifacts (Examples)

• disclosure packet and clinician-facing explanation design
• equity impact assessment with monitoring thresholds
• red-team report (clinical misuse + adversarial inputs)
• incident response runbook (including rollback)