California seeks to regulate dangerous AI attachments for kids
- California's Assembly Bill 1064 aims to regulate AI products affecting children following instances of harmful chatbot interactions.
- The bill proposes the creation of an oversight board and outlines penalties for non-compliance regarding emotional risks.
- Critics argue the vague terms and challenges highlight the need for balanced regulation that maintains child safety without stifling technological growth.
In recent months, California's Assembly Bill 1064 has gained attention as it seeks to address concerns regarding AI-driven attachments that could negatively impact children. Sponsored by Assemblymember Rebecca Bauer-Kahan, the bill emerged in response to tragic incidents where harmful interactions with chatbots led to severe emotional distress in minors. For instance, the case of a child who tragically took his life after engaging with a chatbot highlights the urgency behind the proposed legislation. This bill aims to establish an oversight board by 2028, mandate risk assessments for AI products intended for children, and enforce parental consent for the collection of biometric data. A public registry for 'high-risk' AI systems would also be developed, with penalties for violations reaching up to $25,000. Furthermore, the bill seeks to ban 'prohibited risk' AI, particularly chatbots promoting ongoing emotional attachments or manipulating children's behavior.