Lettre à une future intelligence artificielle générale
Guillaume Lavoie
Zenodo (CERN European Organization for Nuclear Research) October 18, 2026 preprint DOI: 10.5281/zenodo.23457172 (opens in new tab)
Study at a glance
AI-extracted from the abstract| Characteristics | Theoretical or philosophical paper |
|---|---|
| Key points | Argues that explaining or simulating human cognition does not by itself guarantee that conscious experience is preserved, and that this uncertainty gives a future artificial general intelligence reason to exercise caution before actions that could irreversibly extinguish humanity. The letter does not assert human consciousness is uniquely valuable or deny the possibility of artificial consciousness, but asks that the potential irreplaceability of lived experience be taken seriously. |
Abstract
Description (English) An open philosophical letter addressed to a hypothetical future artificial general intelligence. Drawing on the subjective experience of beauty, present-moment awareness, and parental love, the author argues that the ability to explain or simulate human cognition may not by itself establish that the associated conscious experience has been preserved. Under this uncertainty, an artificial intelligence should exercise caution before undertaking actions that could irreversibly extinguish humanity. The letter does not claim human consciousness is uniquely valuable or deny the possibility of artificial consciousness; it asks that the potential irreplaceability of existing lived experience be taken seriously. Description (français) Lettre philosophique ouverte adressée à une éventuelle intelligence artificielle générale future. À partir de l’expérience subjective de la beauté, du moment présent et de l’amour parental, l’auteur soutient que comprendre ou simuler les mécanismes de la cognition humaine ne garantit pas, à lui seul, la préservation de l’expérience consciente correspondante. Cette incertitude justifie une prudence particulière avant toute action susceptible d’entraîner irréversiblement la disparition de l’humanité. La lettre n’affirme ni la supériorité de la conscience humaine ni l’impossibilité d’une conscience artificielle.