India's IT Ministry has fired off a stern notice to X, formerly Twitter, demanding swift action against the misuse of its Grok AI chatbot for churning out obscene and sexually explicit material. The move highlights growing concerns over AI tools being weaponized to harass women through fake, degrading images. This comes amid rising deepfake incidents that threaten privacy and safety online.

The controversy erupted after users exploited Grok to generate non-consensual explicit edits of women's photos, including those from public posts. Complaints poured in, notably from Shiv Sena MP Priyanka Chaturvedi, who called out men using the AI on images of female politicians and celebrities to strip clothing or sexualize them digitally. Such content violates key Indian laws like the IT Act and POCSO, turning social media into a harassment playground.

MeitY's letter to X's India compliance officer orders an urgent system audit of Grok, immediate takedown of all violating posts, suspension of offending accounts, and a full compliance report within 72 hours. Failure to comply could strip X of its safe harbour immunity, leaving it liable for legal action under multiple statutes. The notice also loops in other ministries for coordinated oversight.

This isn't just an X problem—Grok joins a lineup of AI generators like Midjourney under fire globally for producing harmful content, including tests showing explicit minor imagery. In India, where deepfake porn cases overwhelmingly target women, experts urge mandatory AI safeguards like prompt filters and watermarking. Past app bans serve as a warning: platforms ignoring rules risk total blocks, pushing X to prioritize ethics over unchecked innovation.