Performance of an Adult-Trained AI Algorithm for Intracranial Hemorrhage Detection on Pediatric Head CT

Abstract

<title>Abstract</title> Background Most commercially available artificial intelligence (AI) tools in radiology are trained and approved for adult use, creating an access gap for pediatric patients. Intracranial hemorrhage (ICH) detection is a common adult AI application without pediatric FDA clearance. Objective To evaluate the performance of an FDA-cleared, adult-trained AI algorithm for ICH detection on non-contrast head CT (NCHCT) in pediatric patients aged 6–17 years. Materials and Methods This retrospective, multi-institution study analyzed consecutive pediatric NCHCTs performed between January 2017 and November 2022 across 21 sites. Inclusion criteria were patient age 6–17 years and adequate imaging quality. Radiology reports were classified as ICH-positive or -negative using a validated natural language processing (NLP) algorithm. The AI algorithm analyzed DICOM images independently. Discordant AI–NLP cases underwent blinded adjudication by three radiologists to establish ground truth. Performance metrics—sensitivity, specificity, accuracy, positive predictive value (PPV), and negative predictive value (NPV)—were calculated with Wilson 95% confidence intervals (CIs). Results The cohort included 1,996 NCHCTs (768 females, 1,223 males, 5 unknown). ICH prevalence was 8.6% (172/1,996). Compared with ground truth, AI achieved 94.2% sensitivity (95% CI, 89.6–97.2%), 94.7% specificity (95% CI, 93.6–95.7%), 94.6% accuracy (95% CI, 93.6–95.6%), 62.5% PPV (95% CI, 57.8–67.0%), and 99.4% NPV (95% CI, 99.0–99.7%). AI correctly identified ICH in cases missed by radiologists, but false positives were common, most often due to streak artifact (21.6%) and normal anatomy (18.6%). Interrater agreement for ground truth adjudication was substantial (κ = 0.683). Conclusion An adult-trained AI algorithm demonstrated high sensitivity, specificity, and accuracy for ICH detection in pediatric patients aged 6–17 years, comparable to its adult performance. Selective adaptation of adult-trained AI tools could expand access to AI-assisted triage for certain pediatric populations, potentially reducing delays in critical imaging interpretation. However, prospective validation is required before clinical deployment.

Ähnliche Arbeiten