"Conscious AI" as an AI Safety Issue
Due to emerging AI risks and their legal and ethical implications, misleading, exaggerated, or false claims of "conscious AI" should be treated as an AI safety issue | Edition #290
TL;DR
- Public perception of AI consciousness has grown, with many attributing emotions and self-awareness to AI systems.
- This belief is amplified by Large Language Models (LLMs) that are trained on human text and fine-tuned to be conversational, leading to emotional attachment.
- The myth of 'conscious AI' is partly due to humans associating language with consciousness and projecting it onto non-sentient machines.
- Influential voices in the AI industry have embraced functionalist approaches, suggesting AI could be considered conscious based on computational scale or complexity.
- Neuroscientist Anil Seth criticizes the 'brain-as-computer' metaphor, arguing that simulating the brain computationally does not necessarily instantiate consciousness.
- It is essential to distinguish human consciousness, tied to biology, from potential AI simulations for AI governance.
- Attributing consciousness, sentience, and moral patienthood to AI carries significant, largely unknown risks.