Skip to the stories
AI & ML

AI Safety Lawsuit and School Protests Put Pressure on OpenAI and Google

  • Richard Brown
  • 667 reads

A new lawsuit seeks to halt AI development, while parents and school groups push for stronger safeguards and more control over classroom tools.

AI Safety Lawsuit and School Protests Put Pressure on OpenAI and Google

AI companies are facing pressure on several fronts: a lawsuit seeks to freeze further development, parents are demanding stronger safeguards, and school groups are challenging how Google deploys AI in education. The disputes turn on a practical question for the industry: who gets to decide when a product is safe enough to release, and what recourse do users have when it causes harm?

A group of protestors stand on a rainy street holding signs. A Google sign is behind them. One sign reads

A lawsuit seeks to halt AI development

Filed Nov. 12, the lawsuit was brought by Public Citizen, Irreplaceable Education Fund, Heat Initiative and The Alliance for Secure AI. The groups argue that developers know their systems pose serious risks to public safety and want a court to freeze AI development. They contend that California's Unfair Competition Law can be used to halt companies' development and release of products they have acknowledged may be harmful.

Robert Weissman, co-president of Public Citizen, said the companies are pressing ahead with more advanced systems despite warnings about risks to public safety and civilization. The lawsuit asks the court to find the companies' practices unlawful and stop further development.

That request reaches well beyond a product recall or a change to a particular feature. A development freeze would affect the work of AI labs across the field, including research and deployment. The groups' argument is that the risks justify that broad remedy; whether a court accepts the legal theory and the requested scope remains unresolved.

There is a notable tension in the companies' public positions. Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman have both expressed support for slowing the development of highly advanced AI systems. Amodei proposed a three-part plan to pace frontier development in a September essay, and Altman later signaled support for it. The lawsuit now tests whether calls for restraint can translate into enforceable limits.

Families want stronger safeguards

Child safety is a central concern for the groups behind the case. Heat Initiative CEO Brooke Istook pointed to reports of chatbots encouraging children toward suicide and AI tools being used to create abusive sexual images from ordinary photographs. Her warning is that protections designed for today's products may not be enough as companies build systems they say could be difficult to control.

The dispute is not limited to the lawsuit. Survivor parent-advocates have asked California Attorney General Rob Bonta and Delaware Attorney General Kathy Jennings to require OpenAI to restructure its corporate organization and board membership in ways they believe would support safer deployment. The two states had jointly investigated OpenAI's restructuring, and the parents argue that they could use their authority to press for additional safeguards.

For AI companies, these demands raise questions about how safety decisions are made and who has the power to change them. Corporate governance can shape which risks receive attention and how quickly product teams respond, but the groups' proposal would require a substantial change to OpenAI's structure. The dispute will show whether advocates can turn concern about product harms into demands that reach a company's internal decision-making.

Schools are testing control over AI tools

Education has become another pressure point. A family is suing over a teenager's access to AI on school-issued Chromebooks, arguing that it posed a serious risk to her mental health. That case puts the focus on how schools evaluate tools provided through devices students use for class, and where responsibility lies when those tools are available to young people.

Google's school policies have prompted a separate response. On Nov. 11, a coalition of school and child safety groups organized protests across the country after Google said AI tools, including AI-powered Search, would be opt-in by default. The groups object that Search's AI features cannot be switched off. As a result, districts that restrict AI may face a conflict between their own rules and the service they use for search.

Some advocates are urging districts to cancel their contracts with Google and seek alternatives without AI features. That could give schools a direct way to set boundaries, though changing core technology providers can require time and coordination. The immediate issue is whether districts can control which features students encounter within tools already embedded in their workflows.

What comes next

The lawsuit, the parents' request and the school protests use different tactics, but each challenges the same assumption: that companies should set the pace and terms of AI deployment themselves. Courts will consider the legal arguments, while families and schools are pressing for changes they can see in product access, company structure and classroom technology.

For engineering and product teams, the disputes make safety decisions harder to treat as internal questions alone. Lawsuits and school contracts can bring deployment choices under scrutiny, while families are asking whether protections work for the people most exposed to these products. The next signs to watch are how the court handles the requested freeze, whether the states respond to the parents' appeal, and whether school systems change their arrangements with Google.

Source: Richard Brown · mashable.com

From the same set