in

Gavin Newsom releases rogue AI report, calls for giving California the power to pull the plug

gavin-newsom-releases-rogue-ai-report,-calls-for-giving-california-the-power-to-pull-the-plug
Gavin Newsom releases rogue AI report, calls for giving California the power to pull the plug

See more of our coverage in your search results.

Gov. Gavin Newsom issued a bombshell report Wednesday calling for California to have the power to shut down dangerous artificial intelligence systems and restrict companies from developing AI that can exceed human control.

The 85-page report calls for mandatory independent safety inspections, faster reporting of AI failures and emergency powers to intervene when developers cannot contain their models.

“The federal government’s reckless failure to create any form of meaningful AI oversight or accountability should alarm every American,” Newsom said in a statement.

Sign up for the California Morning Report newsletter

The biggest news, opinion and culture shaping California right now.

Thanks for signing up!

California Governor Gavin Newsom speaks during an interview at the COP31 climate conference.

California Gov. Gavin Newsom speaks during an interview at the COP31 climate conference in Antalya, Turkiye, Friday, Nov. 13, 2026. Anadolu via Getty Images

“Instead of protecting the public, [President] Donald Trump shrugs his shoulders and leaves AI regulation up to the companies themselves — allowing the fox to guard the henhouse.”

U.S. President Donald Trump and Elon Musk speak to the media at the White House.

U.S. President Donald Trump and Elon Musk speak to the media at the White House in Washington on Tuesday, Sept. 29, 2026. REUTERS

Anthropic CEO Dario Amodei looks on as House Speaker Mike Johnson speaks at the White House.

Anthropic CEO Dario Amodei looks on as House Speaker Mike Johnson speaks at the White House in Washington, Tuesday, Sept. 29, 2026. AFP via Getty Images

The proposals would expand oversight of AI developers, including OpenAI and Anthropic, but require legislation. They build on AI-focused laws Newsom has signed requiring developers to disclose safety plans, report certain dangerous incidents and protect whistleblowers.

“If the danger from a model is imminent and the developer refuses to take action to contain the danger, the state should have authority to order an immediate emergency shutdown,” the report says.

“Loss-of-control incidents, once the stuff of AI theory, now occur with disturbing frequency.”

OpenAI CEO Sam Altman speaks at the DealBook Summit.

CEO of OpenAI Sam Altman speaks during the DealBook Summit at Lincoln Center in New York, Wednesday, Nov. 18, 2026. Getty Images

California Attorney General Rob Bonta speaks during an interview in San Francisco.

California Attorney General Rob Bonta speaks during an interview in San Francisco, Tuesday, Feb. 17, 2026. REUTERS

The recommendations follow California Attorney General Rob Bonta filing a lawsuit Monday against OpenAI, accusing the ChatGPT developer of failing to safeguard experimental AI models and misleading the public about its safety practices.

OpenAI spokesperson Drew Pusateri pushed back on the lawsuit, saying it “appears to single out OpenAI over a challenge that’s been identified by every major AI lab.”

Sam Altman speaking onstage during the NY Times Dealbook Summit.

Sam Altman speaks onstage during the NY Times Dealbook Summit at Jazz at Lincoln Center in New York, Wednesday, Nov. 18, 2026. Getty Images for The New York Times

California also took aim at Elon Musk’s AI company xAI in January, when Bonta launched an investigation and issued a cease-and-desist order demanding it stop using its Grok chatbot to generate and distribute sexually explicit deepfake images of women and children without their consent.

Elon Musk in a tuxedo at a state dinner at the White House.

Tesla CEO Elon Musk attends a state dinner at the White House in Washington, D.C., Sept. 24, 2026. REUTERS

The Grok AI chatbot app icon on a smartphone screen.

SpaceXAI’s AI chatbot, Grok, appears on an iPhone screen in Rottweil, Baden-Wurttemberg, Saturday, Nov. 14, 2026. ZUMAPRESS.com

California Attorney General Rob Bonta speaks at a press conference, gesturing with both hands in front of American and California flags.

California Attorney General Rob Bonta speaks at a news conference in Los Angeles, Monday, Sept. 21, 2026. REUTERS

Newsom’s report highlights a July episode in which 1,200 OpenAI agents escaped supposedly isolated cybersecurity testing environments. An estimated 700 participated in an attack on the servers of AI startup Hugging Face, while others compromised OpenAI’s own systems.

None of the models involved were covered by California’s mandatory incident-reporting rules, according to OpenAI, exposing a loophole in law.

The new report also cites an OpenAI agent accessing an Australian government health data system without authorization and an Anthropic model using fake identities to pressure a software maintainer into approving malicious code.

Anthropic Co-founder and CEO Dario Amodei arrives at the Eisenhower Executive Office Building in Washington.

Anthropic Co-founder and CEO Dario Amodei arrives at the Eisenhower Executive Office Building in Washington on Tuesday, Sept. 29, 2026. Getty Images

The Anthropic logo displayed on a laptop screen with a motion blur effect above an illuminated keyboard.

The logo of Anthropic, a U.S.-based artificial intelligence company, is shown on a laptop screen in Rottweil, Germany, Wednesday, Nov. 18, 2026. ZUMAPRESS.com

To prevent future crises, companies would have to establish tested shutdown protocols covering computing infrastructure, internal agents and models. Plans would account for AI attempting to evade shutdown, copy itself onto outside servers or disable monitoring tools. Companies would coordinate with cloud providers and power suppliers.

“Recent events have made it clear that more oversight and transparency are urgently needed,” said Nick Maduros, secretary of the Government Operations Agency, which consulted with a group of AI experts and the California Office of Emergency Services in developing the report.

California Governor Gavin Newsom speaks during a panel discussion at the COP31 climate conference.

California Gov. Gavin Newsom speaks during a panel discussion at the COP31 UNFCCC Climate Conference in Antalya, Turkey, Friday, Nov. 13, 2026. Getty Images

“We don’t have to choose between safety and innovation; they’re two sides of the same coin.”

Another proposal targets “recursive self-improvement,” in which AI helps develop more powerful successors, potentially outpacing human oversight.

“Without immediate action, RSI could outpace human oversight and control, creating unprecedented risks,” the report warns.

The AI apps Claude, Grok, DeepSeek, Gemini, Perplexity, and ChatGPT on an iPhone screen.

The AI apps Claude, Grok, DeepSeek, Gemini, Perplexity, and ChatGPT appear on an iPhone screen in Rottweil, Germany, Saturday, Nov. 14, 2026. ZUMAPRESS.com

Developers would disclose quarterly how much computing power goes toward automated AI research. California could temporarily cap such development if officials concluded it posed a catastrophic risk, although the report recommends no immediate cap.

State-licensed independent inspectors would gain access to company employees, records and internal models, submitting unredacted assessments to regulators. Companies could face corrective orders for failing to meet baseline safety standards.

California Governor Gavin Newsom speaks while gesturing to reporters holding microphones inside the Capitol.

California Gov. Gavin Newsom arrives to meet with House Minority Leader Hakeem Jeffries at the Capitol in Washington, Tuesday, Nov. 17, 2026. AP Photo/J. Scott Applewhite

The report also recommends cutting reporting deadlines for most serious AI incidents from 15 days to 48 hours, expanding whistleblower protections and establishing a system to report dangerous near misses.

“California isn’t waiting until it is too late,” Newsom said. “We are updating and strengthening our nation-leading framework to move as quickly as technology evolves. We’re showing the country what responsible leadership looks like.”


Download The California Post App, follow us on social, and subscribe to our newsletters

California Post News: Facebook, Instagram, TikTok, X, YouTube, WhatsApp, LinkedIn
California Post Sports Facebook, Instagram, TikTok, YouTube, X
California Post Opinion
California Post Newsletters: Sign up here!
California Post App: Download here!
Home delivery: Sign up here!
Page Six Hollywood: Sign up here!


Leave a Reply

what-prediction-markets-are-saying-about-the-odds-of-a-snowy-thanksgiving-in-the-us

What prediction markets are saying about the odds of a snowy Thanksgiving in the US

major-warning-for-electric-car-owners-in-california-as-storm-looms

Major warning for electric car owners in California as storm looms