Synthetic media, Pg10

Key Highlights:

• AI-generated deepfakes have proliferated on social media since 2024, raising concerns about electoral integrity and disinformation.
• The Union government proposed mandatory labelling of AI-generated content by amending the IT Rules, 2021.
• Meta, Inc. has already decided to label AI-generated content on Facebook.
• The Coalition for Content Provenance and Authenticity (C2PA) is addressing digital provenance issues.

Detailed Insights:

• Concerns exist that AI-generated misinformation could rapidly spread, disproportionately impacting the democratic process.
• The technology to create deceptive, photorealistic content is rapidly advancing, increasing the potential for misuse.
• Public figures have raised concerns about the unauthorized use of their likenesses in various projects.
• Mandatory labelling has been supported by large social media and AI firms since the rise of synthetic content.
• The IT Rules, 2021, already regulate various online activities but haven't been tested in Parliament.
• Technology regulation often lags behind innovation, requiring the government to act dynamically.
• The government should be prepared to revise existing rules and introduce new ones as needed.

Key Concepts Involved:

• Deepfakes: AI-generated synthetic media, such as images and videos, that can convincingly mimic real people or events.
• Digital Provenance: A record of the origin and history of a digital asset, used to verify its authenticity.
• IT Rules, 2021: Indian regulations governing intermediaries and digital content, including social media platforms.