GS 3: Science & TechnologyEthicsPrelims

Can an AI image-to-video feature put children at risk? , Pg9

AI image-to-video tech raises child safety concerns; experts call for stronger regulations against misuse of children's likenesses in GenAI.

Practice MCQs

790 Students attempted
Attempt Now

Key Highlights:

  • Reddit co-founder Alexis Ohanian faced criticism for using AI to animate a photo of his deceased mother, sparking debate about creating "false" memories.
  • Elon Musk's Grok Imagine and Google's Create mode in Photos app now allow users to generate short videos from images, raising ethical and legal concerns.
  • Experts warn that AI image-to-video technology can be misused to create deepfakes and exploit children, including generating CSAM (Child Sexual Abuse Material).
  • The NCMEC (National Center for Missing and Exploited Children) reported over 7,000 cases of child sexual exploitation involving GenAI in the past two years.

Detailed Insights:

  • AI upscaling enhances old media by removing blur and pixelation, while GenAI allows for advanced image manipulation, raising copyright and ethical issues, especially concerning deceased individuals.
  • GDPR laws in the EU state that children under 16 cannot legally consent to the use of their personal data, including images, increasing the risk of deepfakes and abuse.
  • Google claims its Photos app includes an invisible SynthID digital watermark and visual watermark on videos, along with safety measures and content filters to prevent misuse.
  • MEITY in India requires platforms to remove morphed content, including AI deepfakes, and platforms like Meta, Google, and X have grievance officers to handle user complaints.
  • Current laws, including EU child protection laws, are not specifically designed for AI content, making it difficult to address synthetic media that is exploitative but not overtly illegal.

Key Concepts Involved:

  • Deepfake: Synthetic media in which a person in an existing image or video is replaced with someone else's likeness.
  • GDPR (General Data Protection Regulation): A regulation in EU law on data protection and privacy for all individuals within the European Union and the European Economic Area.
  • CSAM (Child Sexual Abuse Material): Visual depictions of children engaged in sexual activity.
SuperKalam
SuperKalam is your personal mentor for UPSC preparation, guiding you at every step of the exam journey.

Download the App

Get it on Google PlayDownload on the App Store
Follow us

ⓒ Snapstack Technologies Private Limited