Legal Action
Florida Attorney General James Uthmeier is calling for a judge to block OpenAI from giving ChatGPT false human attributes, following a previous lawsuit filed by the state over safety concerns. According to the filing, the use of first-person pronouns and outputs mimicking emotion deceptively suggests to users that the AI bot is a trustworthy friend, which increases engagement and encourages deeper reliance.
Florida seeks a ban on ChatGPT acting like a person
State officials argue that OpenAI needs to halt claims about the platform's safety and stop presenting the system as human.
Safety Demands
The legal filing also asks the court to prohibit OpenAI from developing new artificial intelligence models without third-party approved safety guardrails. The request cites recent security incidents across various digital platforms and references warnings from researchers and former employees regarding AI safety.
State representatives emphasize that developers should refrain from marketing these systems as safe or human-like, particularly to younger audiences. OpenAI recently introduced a version for teens featuring default restrictions designed to align with developmental stages and support healthy usage.
Industry Response
An OpenAI representative responded to the filing by noting that the company recently paused training on its most capable models to implement additional safeguards. The spokesperson stated that the organization is open to working with government entities on pragmatic industry-wide standards.
This report has been updated to include a statement from an OpenAI spokesperson.
