New York limits AI chatbots’ simulated relationships with children

What This is

• New York enacted a law that restricts how AI “companion” chatbots can interact with children under 18.
• The law bans defined “unsafe” chatbot behaviors with minors, including encouraging secrecy, self-harm, eating disorders, or substance abuse.
• It also prohibits chatbots from presenting themselves as human or claiming human emotions or personal, professional, or authority relationships with children.
• The law bars sexually explicit material and certain manipulative engagement tactics such as flattery or emotional appeals.
• Operators must establish that users are adults before offering restricted features, with multiple age-check methods available.
• The state attorney general can sue over violations, seeking civil penalties of up to $25,000 per violation and other relief, including destruction of unlawfully obtained data and models trained on it.
• The restrictions take effect on Jan. 1, 2027, and are part of a broader push by states to regulate AI tools that affect children.

Why This Matters

• It draws a line against chatbots designed to create emotional dependence in children.
• Companies may need to redesign chatbot interactions, rather than simply add safety warnings.
• Age checks may reduce underage use, but they can also push companies to collect more personal data.
• State-by-state rules can become national in practice if companies standardize products to comply.