Grok AI Obscene Content Issue: Government Seeks Detailed Action Report From X

The central government has sought additional clarification from X regarding the steps it has taken to curb the generation of obscene and sexually explicit content through its AI chatbot Grok, after finding the company’s initial response insufficient, sources familiar with the matter said.

The Ministry of Electronics and Information Technology (MeitY) had earlier issued a stern directive to the Elon Musk-owned platform following complaints that Grok and other AI-enabled tools were being misused to create and circulate non-consensual sexualised images of women. While X submitted a response to the ministry within the stipulated timeline, officials said the explanation lacked concrete details on enforcement and preventive mechanisms.

According to sources, the government has now asked the platform to provide a clearer, action-oriented report outlining what immediate steps have been taken against offending content, how violations were identified, and what technological or policy safeguards are being put in place to prevent recurrence.

The platform has been given extended time until Wednesday, 5 pm, to submit a comprehensive action taken report. Officials described the extension as conditional, signalling that the matter is being treated with seriousness due to its implications for online safety, women’s rights and AI governance.

Response Found “Detailed But Inadequate”

In its earlier submission, X reportedly stated that it respects Indian laws and regulatory frameworks, highlighting India as a key market for its operations. The company also outlined its existing content moderation policies, particularly those related to misinformation and non-consensual sexual content.

However, government officials said the response remained largely policy-focused and failed to explain how those rules were being enforced specifically in the context of Grok-generated content. The ministry is understood to be seeking clarity on whether any accounts were suspended, content removed, or AI safeguards strengthened following the complaints.

“The response explains what policies exist, but not what action has been taken,” a source said, adding that platforms deploying generative AI tools must demonstrate accountability beyond general assurances.

Focus on AI Misuse and Platform Responsibility

The issue has renewed debate around the misuse of generative AI systems and the responsibility of digital platforms to ensure that emerging technologies do not facilitate harm. With AI tools becoming more accessible, regulators are increasingly concerned about their potential to amplify abuse, particularly against women.

Officials emphasised that AI-driven services operating in India are required to comply with existing IT rules, including provisions related to unlawful content, user safety and grievance redressal. Failure to do so could invite further regulatory action.

The government has also sought information on what technical modifications, if any, have been introduced to Grok to limit its ability to generate explicit or harmful outputs, and whether human oversight has been strengthened for flagged content.

Wider Regulatory Implications

The Grok controversy comes at a time when India is sharpening its focus on AI governance and platform accountability. Policymakers have repeatedly stressed that innovation cannot come at the cost of user safety or legal compliance.

The outcome of this engagement between MeitY and X is being closely watched, as it may set an important precedent for how AI-related violations are handled going forward. Officials have made it clear that platforms will be expected to demonstrate proactive compliance rather than reactive explanations.

As the deadline approaches, the ball is firmly in X’s court to convince regulators that adequate corrective and preventive measures are in place to address the misuse of AI-generated content on its platform.