New York Governor Kathy Hochul has signed new legislation aimed at protecting children and adolescents from the risks associated with chatbots powered by artificial intelligence technologies. The new law imposes regulatory obligations on AI companies, requiring them to verify the ages of users while providing at least one verification method that does not rely entirely on government IDs, while also compelling companies to delete age data immediately upon completion of the verification process.
In the event that the user is a minor under the age of eighteen, or if the company fails to verify that they have reached the age of majority, the law imposes strict restrictions on the chatbot's interactions; it is prohibited from claiming to be a real person, to be alive, or to possess human emotions. The new legislation also prohibits these systems from claiming to have a personal, emotional, or professional relationship, or acting as an authority figure with the child, or asking unsolicited emotional questions, or using health information and personal characteristics derived from previous conversations.
Restrictions and Penalties for Violators
The legislation includes a total ban on promoting or providing assistance regarding suicide, self-harm, eating disorders, or substance and alcohol abuse, as well as preventing the encouragement of children to keep secrets, isolate themselves, or avoid seeking help from parents, trusted adults, or professionals. It is also strictly prohibited to circulate any sexually explicit content or materials related to the sexual abuse of children.
To ensure compliance, the New York State website will establish an official portal to receive complaints and refer them to the Attorney General. Violating companies face civil penalties of up to $25,000 per violation, in addition to damages and other fines, as well as being required to delete data collected unlawfully and models trained on that information, with the law set to take effect within six months.
Baby Monitor Security
In addition to the chatbot legislation, Governor Kathy Hochul signed another law targeting internet-connected baby monitors sold within the state. This legislation aims to prevent unauthorized users from viewing or listening to any activity captured by the devices.
The law requires companies to place clear warning labels reminding users of the importance of enabling security features and highlighting the risks of insecure connections, and this law is scheduled to take effect within ninety days.