Terms

AI Safety

Follow the latest coverage, related explainers and connected technology stories.

Latest coverage

CN
OpenAI Executive’s Resignation Revives Debate Over the Pace of AI Model Development

OpenAI Executive’s Resignation Revives Debate Over the Pace of AI Model Development

David Robinson resigned from OpenAI’s safety systems team, criticizing the company’s culture and the speed of its model development, and warning that unchecked optimism could increase the risks of dealing with highly capable systems. OpenAI says it postpones training or launches when necessary and is expanding external evaluation and real-time monitoring.

CN
Anthropic Targets a Valuation of Two Trillion Dollars Despite Massive Losses and Warnings About AI Risks

Anthropic Targets a Valuation of Two Trillion Dollars Despite Massive Losses and Warnings About AI Risks

Anthropic is preparing to offer its shares to the public at a target valuation of up to two trillion dollars, with plans to spend approximately $518 billion on computing, chips, and infrastructure. The offering prospectus reveals significant losses, revenue concentration, and extensive warnings about the risks of advanced artificial intelligence models.

CN
Jensen Huang: AI safety is an engineering problem, not a legal one

Jensen Huang: AI safety is an engineering problem, not a legal one

Jensen Huang believes AI companies can manage product risks through engineering and market forces, without the need for new laws. However, TechCrunch’s analysis questions whether this approach is sufficient, citing software, technology product, and AI-related harms.

CN
OpenAI, Anthropic, and Google DeepMind Hold Joint Talks on AI Safety

OpenAI, Anthropic, and Google DeepMind Hold Joint Talks on AI Safety

OpenAI confirmed that discussions about AI safety have been ongoing for weeks with Anthropic and Google DeepMind, alongside calls to establish an independent standards body and a mechanism for verifying the safety of advanced models. This comes amid warnings about antitrust-law risks and opposition within the U.S. administration to tighter regulation out of concern for maintaining competition with China.

CN
China Criticizes Proposal to Slow AI Development, Calling It a Cold War Tactic

China Criticizes Proposal to Slow AI Development, Calling It a Cold War Tactic

Chinese media and China’s Foreign Ministry rejected Anthropic’s CEO’s call to slow the development of artificial intelligence, arguing that the proposal could become a means of excluding China from global innovation. The dispute reveals a conflict between demands for technical safety and geopolitical restrictions on advanced chips and models.

CN
Experts Propose Balance Instead of Slowing AI Development or Leaving It Unrestricted

Experts Propose Balance Instead of Slowing AI Development or Leaving It Unrestricted

Experts in artificial intelligence policy and ethics have called for balancing the speed of model development with safety and regulatory requirements, following warnings from within major companies that progress could outpace society’s ability to understand and control it. The experts believe that cooperation among companies, governments, and civil society should accompany technological competition.

CN
Anthropic CEO Proposes Plan to Slow the AI Race

Anthropic CEO Proposes Plan to Slow the AI Race

Dario Amodei proposed three mechanisms to “slow the pace of progress” in artificial intelligence models, including independent monitors within companies, shared safety standards, and international coordination. Anthropic, for its part, is committing to providing expanded access to external evaluators, while the feasibility of the proposals and their potential conflict with competition laws remain open questions.

CN
Repeated Resignations and Restructuring Put Pressure on OpenAI Ahead of a Potential IPO

Repeated Resignations and Restructuring Put Pressure on OpenAI Ahead of a Potential IPO

OpenAI is undergoing successive organizational changes and the departure of several senior executives, as it potentially prepares for a public offering that could raise its valuation to around $1 trillion. This comes as the company redistributes artificial intelligence safety responsibilities and faces intensifying competition from Anthropic in the enterprise market.