"A cold, technical decision-maker": Can AI provide explainability,\n negotiability, and humanity?

Abstract

Algorithmic systems are increasingly deployed to make decisions in many areas\nof people's lives. The shift from human to algorithmic decision-making has been\naccompanied by concern about potentially opaque decisions that are not aligned\nwith social values, as well as proposed remedies such as explainability. We\npresent results of a qualitative study of algorithmic decision-making,\ncomprised of five workshops conducted with a total of 60 participants in\nFinland, Germany, the United Kingdom, and the United States. We invited\nparticipants to reason about decision-making qualities such as explainability\nand accuracy in a variety of domains. Participants viewed AI as a\ndecision-maker that follows rigid criteria and performs mechanical tasks well,\nbut is largely incapable of subjective or morally complex judgments. We discuss\nparticipants' consideration of humanity in decision-making, and introduce the\nconcept of 'negotiability,' the ability to go beyond formal criteria and work\nflexibly around the system.\n

Ähnliche Arbeiten