According to reporting by The Verge, a series of new video interviews features current and former artificial intelligence researchers from major companies such as OpenAI, Google DeepMind, and Anthropic warning about the severe risks of advanced AI. Among them, former OpenAI and Google DeepMind employee Geoffrey Irving stated that the chance of human extinction from superintelligence is roughly a coin flip. The project was put together by Palisade Research, a non-profit organization that studies artificial intelligence systems.
The Debate Over Existential Risk
Concerns regarding AI safety and existential risk have long divided the technology sector, pitting accelerationists who want to deploy systems rapidly against safety researchers advocating for strict oversight. While prominent labs routinely publish internal safety frameworks and alignment research, public warnings from individuals directly involved in developing these systems highlight ongoing internal tensions regarding how close the industry might be to achieving artificial general intelligence or superintelligence.
What Remains Unknown
The released interviews do not specify a concrete timeline for when researchers believe superintelligence might be achieved, nor do they detail the exact technical mechanisms by which an advanced system could cause human extinction. Furthermore, the announcement did not specify how many total researchers were interviewed or whether the participants spoke on behalf of their current employers. Observers will need to watch for future disclosures from Palisade Research and responses from the major AI labs mentioned in the reports.
As laboratories continue to scale their computing clusters and train larger models, the public debate surrounding the governance and safety of frontier artificial intelligence is expected to intensify.
Lead image: panumas nikhomkhai / Pexels