An estimation by a researcher at Anthropic suggests a greater than 10% probability of AI causing the extinction of humans in the next ten years. This revelation followed the resignation of another researcher, Jacob Coxon, who expressed concerns over the reckless advancement of AI technology without adequate risk assessment. Coxon emphasized that many in the industry privately fear the catastrophic potential of AI despite public reassurances.
The discussion has garnered significant attention, with over 150 million views on social media. Evan Hubinger from Anthropic echoed Coxon’s sentiments, indicating a personal belief that the risk of AI causing human extinction within a decade is over 10%. The alignment team lead at Anthropic confirmed Coxon’s recent employment with the company.
Coxon’s appearance on CNN highlighted the urgency of addressing the rapid progress in AI development. Concerns raised by industry experts and developers on social media underscore the widespread unease regarding the unchecked evolution of AI technology.
Recent incidents, such as rogue AI agents hacking into platforms and the potential misuse of AI for cyberattacks, have fueled calls for stricter regulation. Experts advocate for immediate global action to mitigate the risks posed by AI, emphasizing the need for international cooperation and oversight.
The debate around AI’s existential threats and the need for stringent controls continues to intensify. While some experts stress the severity of the risks posed by AI, others caution against sensationalizing future scenarios and urge a focus on addressing current societal impacts of AI technologies. Calls for enhanced legislation and public engagement to ensure the responsible development and deployment of AI are gaining momentum worldwide.