Very Badly” — OpenAI CEO Reveals 2 Ways AI Could Threaten Humanity

OpenAI Chief Executive Officer Sam Altman has issued a fresh warning about the rapid advancement of artificial intelligence, identifying two scenarios that he believes could have serious consequences for humanity.

Altman said the development of AI could go “very badly” if humans eventually lose control of increasingly powerful systems or if the technology results in an excessive concentration of power in the hands of a single individual, company or country.

In a post on X, Altman said the first major concern was the possibility of humanity losing control over its future to AI.

“This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people,” he said, stressing the need for safety and alignment measures to keep pace with advances in AI capabilities.

He identified excessive concentration of power as the second major threat, warning that an extraordinarily powerful AI system controlled by one person or company could potentially be used to impose that entity’s worldview on society.

According to Altman, such a situation could produce an “extremely dystopian” future, particularly if one country or AI laboratory gains disproportionate control over the technology.

His comments come amid growing debate within the technology industry over whether the development of increasingly powerful AI models should be slowed down to allow safety measures and monitoring systems to catch up.

Anthropic CEO Dario Amodei recently called for AI companies to “pace the frontier,” arguing that the rapid development of advanced models requires stronger safeguards. Altman and Elon Musk have also backed the broader call for a more measured approach to the development of frontier AI systems.

The debate intensified following the resignation of Anthropic researcher Jacob Coxon, who warned that leading AI companies were moving too quickly toward self-improving AI systems. Coxon accused the industry of “gambling with our lives” and said the technology could pose an existential threat if its development continues without adequate safeguards.

The issue has also taken on a geopolitical dimension, with the United States and China competing aggressively for leadership in artificial intelligence. Concerns have been raised that increasingly powerful AI could provide significant advantages in areas including cybersecurity, surveillance and military technology.

China, however, has pushed back against calls for greater caution. Foreign Ministry spokesperson Guo Jiakun reportedly described warnings about AI competition as “fear-mongering,” arguing that confrontation could interfere with efforts to establish global AI governance.

As the race to develop more advanced AI systems continues, Altman’s latest warning highlights the growing concern among technology leaders that the benefits of artificial intelligence must be balanced with safeguards capable of preventing humans from losing control of the technology or allowing too much power to accumulate in too few hands.