A short-form AI literacy intervention can reduce over-reliance on AI

Abstract

Artificial intelligence (AI) is becoming very capable, and can match or even exceed human performance in various tasks. Human-AI teams are necessary to maintain oversight over AI, however, humans tend to over-rely on AI, especially when their trust is high. New research has emerged showing that interventions that improve AI literacy—knowledge and understanding of AI—appear to reduce over-reliance on AI, however it is unclear what is mediating this effect. Further, AI literacy in the general public is poor, and short-form interventions that aim to teach about important AI concepts are sparse. We aimed to test whether a short, 5-minute text-based AI literacy intervention would improve AI literacy and reduce over-reliance on AI. We recruited 153 undergraduate psychology students from the University of Queensland and randomly assigned them to receive either the AI literacy intervention or a similarly-lengthed control material unrelated to AI, and subsequently tested their reliance on AI in a human-AI team context. We found that, compared with the control condition, those who received the literacy intervention had significantly improved AI literacy and significantly reduced over-reliance, though there was no indirect effect of the intervention on over-reliance through AI literacy or trust. Our findings highlight the potential for short-form AI literacy interventions in not only improving AI literacy but reducing over-reliance on AI in a human-AI team context, however, more research is necessary to bring clarity to what may be mediating this effect.

Ähnliche Arbeiten