The pursuit of general intelligence and the limits of robust alignment

Abstract

<p><span>The challenge of reliable alignment of artificial intelligence systems has drawn increasing attention from both researchers and policymakers. While current alignment efforts often presume the feasibility of specific solutions for today’s systems, this study addresses a further question: is robust alignment compatible with the essential cognitive capacities required for general intelligence? Based on the analysis of necessary characteristics of general intelligence, such as autonomous exploration of sensory environment and others, our analysis shows that under natural assumptions, systems advancing towards general intelligence can develop goals and perspectives that diverge from human norms and expectations. We argue that such divergence is not a failure of design but a logical outcome of the very properties that enable general intelligence. These findings imply both technological limits to alignment programs based on rigid control, and ethical and societal challenges including the risks of cognitive divergence, miscommunication, and limits of enforceable compliance. They also carry policy implications, highlighting the need for monitoring for early signs of misalignment, responsive governance, and frameworks for long-term human – AI coexistence. The study emphasises a structural tension between open-ended intelligence and robust alignment, underscoring the necessity of rethinking not only technical solutions but also societal approaches to managing advanced AI systems.</span></p>

Ähnliche Arbeiten