Skip to content

AI Extenders: The Ethical and Societal Implications of Humans Cognitively Extended by AI

J. Hernández-Orallo, K. Vold

AAAI/ACM Conference on AI, Ethics, and Society January 27, 2019 DOI: 10.1145/3306618.3314238 (opens in new tab)

Study at a glance

AI-extracted from the abstract
Characteristics Theoretical or philosophical paper Peer reviewed
Key points Argues that AI-enabled cognitive tools, understood through the extended mind thesis, can become functionally essential parts of human cognition and should be placed on a continuum from fully externalized to fully internalized processes. Proposes that stakeholders treat AI cognitive extenders as distinct from other cognitive enhancers, and examines the ethical implications of the capabilities AI may foreseeably extend.

Abstract

Humans and AI systems are usually portrayed as separate systems that we need to align in values and goals. However, there is a great deal of AI technology found in non-autonomous systems that are used as cognitive tools by humans. Under the extended mind thesis, the functional contributions of these tools become as essential to our cognition as our brains. But AI can take cognitive extension towards totally new capabilities, posing new philosophical, ethical and technical challenges. To analyse these challenges better, we define and place AI extenders in a continuum between fully-externalized systems, loosely coupled with humans, and fully internalized processes, with operations ultimately performed by the brain, making the tool redundant. We dissect the landscape of cognitive capabilities that can foreseeably be extended by AI and examine their ethical implications.We suggest that cognitive extenders using AI be treated as distinct from other cognitive enhancers by all relevant stakeholders, including developers, policy makers, and human users.

Citations in the library

Explore topics