How Deepfakes on Instagram, X Cast Shadow Over Women’s Dignity and Privacy, Pg13.

Key Highlights:

• A viral deepfake of a Hindi film actress on Instagram sparked outrage, showing how synthetic media is misused to create sexually suggestive content.
• On October 22, the Central Government proposed rules making it mandatory to label AI-generated content on platforms like Instagram and X.
• Uploaders must declare whether the content is “synthetically generated” to ensure accountability.
• Platforms such as Instagram and X have been criticized for their slow response and lack of clear takedown mechanisms.
• According to reports, nearly 90% of deepfake victims are women, often targeted through digitally altered sexualized imagery.
• The IT Ministry issued an advisory warning against AI misuse and directed platforms to strengthen moderation and labeling systems.

Detailed Insights:

• Nature of the Threat:
  • Deepfakes use AI-driven image synthesis to manipulate photos and videos, blending real and fake visuals indistinguishably.
  • Such content spreads rapidly across social media, leading to harassment, character defamation, and mental trauma for victims.
• Origins and Growth:
  • Technology for AI-based face swaps emerged in 2017, initially in pornography forums, and has now entered mainstream social media.
  • The 2023 incident involving actress Rashmika Mandanna triggered renewed awareness and legal debate in India.
• Legal and Policy Response:
  • The government plans to amend IT Rules, 2021, making it mandatory for creators and platforms to label AI-generated media.
  • Platforms like Meta and Google are being pushed to deploy proactive detection and removal systems for manipulated content.
  • The Delhi High Court has directed platforms to act swiftly on complaints regarding non-consensual AI imagery.
• Ethical and Social Implications:
  • Deepfakes weaponize technology against women, infringing their right to privacy, dignity, and reputation (Article 21).
  • They pose a dual threat — spreading misinformation and digital sexual violence.
  • The trend reflects a growing AI ethics gap, where technological progress outpaces social safeguards.

Scientific/Technical Concepts Involved:

• Deepfake: AI-generated or altered visual/audio content created using Generative Adversarial Networks (GANs) to make fake media appear realistic.
• Synthetic Media: Content wholly or partially generated by AI algorithms, including manipulated audio, video, or images.
• Watermarking: A technical method of embedding metadata or digital signatures to identify AI-generated or altered content.
• Algorithmic Moderation: Automated use of AI to detect, flag, or remove harmful content across digital platforms.