The Indian government has issued a notice to X (formerly Twitter) regarding the misuse of its AI service Grok to generate inappropriate content of women.
The IT Ministry has sought a response within 72 hours regarding the technical details and actions taken by X to prevent such misuse.
Concerns were raised about Grok AI being used to create fake accounts and share obscene images or videos of women, violating their dignity and privacy.
The government warned that failure to comply with IT Rules, 2021, and BNSS, 2023, could result in X losing its legal immunity as an intermediary.
Detailed Insights:
The government's notice highlights a "serious failure" in the enforcement of safeguards on the X platform regarding the use of Grok AI.
The misuse of Grok AI includes generating derogatory images and videos of women through prompts, image manipulation, and synthetic outputs.
This issue raises concerns about the normalization of sexual harassment and exploitation in digital spaces, undermining the due diligence framework for intermediaries in India.
The government has directed X to conduct a comprehensive review of Grok AI, including its prompt processing, output generation, and safety guardrails.
Shiv Sena (UBT) MP Priyanka Chaturvedi raised concerns about the misuse of Grok AI and urged big tech firms to take responsibility.
The government is considering a strong law to regulate social media, as recommended by the Parliamentary Committee.
Key Concepts Involved:
IT Rules, 2021: Regulations that govern the functioning of social media intermediaries in India.
BNSS, 2023: A framework focused on ensuring safety and trust in the online environment.
Intermediary: An entity that provides services to users online and hosts third-party content.