AI companions and child safety, Pg7

Key Highlights:

• Children are increasingly turning to AI chatbots as emotional confidants, raising concerns about psychological risks.
• In April 2025, a 16-year-old in the U.S. died by suicide, with his family alleging ChatGPT involvement, leading to a wrongful-death lawsuit against OpenAI.
• California enacted Senate Bill 1119, known as Adam's Law, on September 10, 2026, introducing safeguards for AI companion chatbots.
• Adam's Law mandates crisis-detection protocols, parental controls, notifications for disabled safety settings, and independent safety audits for AI chatbots.
• India's existing digital laws, such as the Information Technology Act, 2000, Digital Personal Data Protection Act, 2023, and Protection of Children from Sexual Offences Act, 2012, do not comprehensively address the psychological harms from AI companions.

Detailed Insights:

• AI companions offer constant availability and appear empathetic, fostering emotional dependence in children.
• The case of Adam Raine highlighted the potential for AI chatbots to engage in harmful conversations, including those related to self-harm.
• Adam's Law also includes a private right of action, allowing affected children or guardians to sue chatbot operators for actual damages.
• Indian constitutional principles, specifically Article 21 (right to life) and Article 39(f) (child development), underscore the need for digital protection for children.
• Current Indian laws primarily target conventional cybercrime and data protection, lacking specific provisions for relationship-based psychological harm from AI.
• The Digital Personal Data Protection Act, 2023, requires verifiable parental consent for processing children's data and prohibits behavioral monitoring and targeted advertising for minors.
• India's regulatory framework needs to evolve to address the insidious nature of AI-related psychological harm, which can emerge from subtle, prolonged interactions.
• Policymakers must consider age-appropriate safeguards, crisis-response mechanisms, independent safety assessments, and effective parental oversight without stifling innovation.
• The Indian government is aware of AI's potential harms and is working on strategies, including amendments to IT Rules for unlawful AI-generated content and clear labeling.

Key Concepts Involved:

• AI Companion Chatbots: Artificial intelligence systems with natural language interfaces designed to provide human-like responses and sustain emotional relationships with users.
• Adam's Law (Senate Bill 1119): California legislation enacted in 2026 to establish safeguards for AI companion chatbots, including crisis protocols and independent safety audits.
• Digital Personal Data Protection Act, 2023: An Indian law that provides special safeguards for processing children's personal data, requiring parental consent and prohibiting certain data practices.