The Potential of AI in Nursing Care: A Multi–Center Evaluation in Fall Risk Assessment (Preprint)

Abstract

<sec> <title>BACKGROUND</title> With 28%-32% of individuals aged 65 and older experiencing incidents of falling, falls are the second leading cause of unintentional injury-related deaths globally. The limited availability of clinical staff often impedes timely detection and prevention of potential falls. Advancements in artificial intelligence (AI) could complement existing fall risk assessment and help to better allocate nursing care resources. Yet, many studies are based on small data sets from a single institution, which can restrict the generalizability of the model, and do not investigate important aspects in AI model development such as fairness across demographics. </sec> <sec> <title>OBJECTIVE</title> This study aims to provide a comprehensive empirical evaluation of the potential of AI in nursing care, focusing on the case of fall risk prediction. To account for demographic and contextual differences in fall incidents, we analyze data from a university and geriatric hospital in Germany, accounting for the largest datasets for fall risk prediction to date and representative for a key challenge in health care: heterogeneous data distributions. We focus on three key objectives: Does AI help in improving fall risk prediction? Which approaches should be considered and how can AI models be trained safely across different hospitals? Are these models fair? </sec> <sec> <title>METHODS</title> This study used two datasets for fall risk prediction: one from a university hospital with 932,912 subjects, 3,351 of whom experienced falls, and another from a geriatric hospital with 12,773 subjects, 1,728 of whom have fallen. State of the art AI models were used within three experimental approaches. First, separate models were trained on each hospital’s data; second, models were retrained on the respective other dataset; and finally, Federated Learning (FL) was applied to both datasets for collaborative learning. The performance of these models was compared to the rule-based systems for fall risk prediction. Additional analysis was conducted to ensure model fairness. </sec> <sec> <title>RESULTS</title> Our findings demonstrate that AI models consistently outperform rule-based systems across all experimental setups, AUROC of 0.735 (90% CI 0.727 - 0.744) for the geriatric, and 0.93 (90% CI 0.928 - 0.934) for the university hospital. FL did not improve the fall risk prediction in this setting. Our fairness analysis ruled out disparities in model performance across different gender groups, but we found fairness infringements in age-based performance. </sec> <sec> <title>CONCLUSIONS</title> This study demonstrates that AI models consistently outperform traditional rule-based systems across heterogeneous datasets in predicting fall risk. However, it also reveals the challenges related to demographic shifts and label distribution imbalances, which likely limited the FL models’ ability to generalize. While the fairness analysis indicated promising predictive parity and equal opportunity across gender subgroups, age-related disparities emerged. Addressing data imbalance and ensuring broader representation across demographic groups will be crucial for developing more fair and generalizable models. </sec>

Ähnliche Arbeiten