Story
September 22, 2026
California Bets an AI Kill Switch Can Fill Washington’s Void
California is presenting state action as the answer to a federal vacuum on AI safety, while the Trump administration and some technology leaders argue that company responsibility and engineering discipline—not another layer of regulation—should lead the response.
The argument intensified after warnings about increasingly capable AI systems—and reports of breaches and agents evading controls—pushed safety from a theoretical concern into a political one. By Sept. 12, Elon Musk was urging competitors to test one another’s models, arguing that self-policing has obvious blind spots: “It’s tough when you’re grading your own homework.”1
Three days later, Nvidia chief executive Jensen Huang offered a different version of caution. Safety, he said, is an engineering obligation: companies should not release products until they are confident in them. But Huang’s conclusion diverged sharply from Sacramento’s emerging approach: “We don’t need any new laws. We don’t need new regulations.”1
On Sept. 18, Gov. Gavin Newsom moved California toward the regulatory route. His executive order gives experts two months to recommend stronger state safeguards for frontier AI, including independently verified audits, standardized transparency and risk reports, mandatory reporting of serious safety incidents and a potentially required emergency “kill switch.” The order also accelerates implementation of California’s new framework for independent AI verifiers and a registry of auditors.2
Newsom framed the move as a response to Washington’s paralysis, declaring that the federal government’s “abject failure” to establish meaningful oversight “should alarm every American.” California, he said, would act “thoughtfully but with urgent velocity.”3
The clash is not merely between advocates of caution and acceleration. The Trump administration has favored enforcing existing laws while leaving AI safety chiefly to companies; AI czar David Sacks said firms must “internalize the sense of responsibility,” rather than shift it elsewhere.1 Congressional resistance remains visible, too: Sen. Rand Paul objected to an emergency-kill-switch bill, saying regulation could arrive too early and hold the technology back.
Newsom’s wager is that California’s rules can become the national floor. His critics’ wager is that mandates may prove slower, blunter and less effective than the industry discipline the governor no longer trusts to stand alone.