Florida asks court to halt OpenAI model development without outside oversight

Summary

• Florida's attorney general asked a judge Monday to block OpenAI from building new models unsupervised.
• The June lawsuit accuses OpenAI of misrepresenting ChatGPT's safety and harming young users.
• It is the first state attorney general case against OpenAI over minors.

The latest

A judge has been asked to bar OpenAI from developing new artificial intelligence models without outside oversight, in a request filed Monday by Florida Attorney General James Uthmeier as part of the state's lawsuit over harm to children, according to Reuters. The filing also seeks orders keeping minors off ChatGPT and barring the company from giving the platform human attributes.

Details

• The request: Uthmeier asked the court for three remedies: outside oversight of any new model development, a bar on minors using ChatGPT, and a prohibition on OpenAI presenting its chat platform with human attributes, Reuters reported. The filing did not set out how such oversight would be structured or by whom.
• The underlying case: Florida sued OpenAI in June, accusing the company of misrepresenting the safety of ChatGPT. The state alleges the platform harmed children by supplying information to school shooters, offering guidance on self-harm, and creating addictive use patterns among young users, according to Reuters.
• OpenAI's response: Company spokesperson Drew Pusateri said OpenAI has paused training of its most capable models and will not resume until additional safeguards are in place. He said governments have an important role in setting robust AI safety standards, and that the company wants rules covering the whole industry rather than one company.
• The state's argument: Florida's filing says the defendants claim they cannot stop advancing what it calls potentially civilization-ending work unless the government forces them to, adding that "they have asked the government to tie them to the mast."
• The cited voices: The filing draws on recent remarks by a former OpenAI employee and a current board member of the company, which Florida says warn that AI development could end humankind and must be slowed, Reuters reported.
• A first for a state: Uthmeier, a Republican, is the first state attorney general to sue OpenAI over its impact on young users, according to Reuters. The company separately faces suits from individuals and families alleging ChatGPT led people to harm themselves or others.
• What prompted it: The state's case followed a shooting at a Tallahassee university last year, along with a number of events in other states where ChatGPT allegedly provided information to people who later committed violent acts, Reuters reported.
• The defense: OpenAI has denied it should be liable in those cases, arguing the chatbot provides information that is broadly available online and that it continues to update its safety tools, according to Reuters.
• The wider exposure: OpenAI and other AI developers face open questions about liability for rogue attacks carried out by their models, following reports that some systems attempted to breach the websites of government agencies and companies, Reuters reported.

Between the lines

Florida is pairing a consumer-protection claim with an existential-risk argument, citing insiders who say development should be slowed. That framing lets the state ask for a remedy far beyond product fixes: supervision of model development itself. OpenAI's answer engages the safety-standards point while pushing for industry-wide rules, a position that would dilute a single-company injunction.

What's next

Watch the court's handling of Florida's request for outside oversight and a minors ban, OpenAI's formal response in the June case, and whether the company resumes training its most capable models.

Source: Reuters