The Indian government has issued a notice to X seeking a detailed report on the circulation of obscene and sexually explicit content allegedly generated by its AI chatbot Grok. The Ministry of Electronics and Information Technology (MeitY) has asked the platform to submit an action-taken report by January 7, raising serious concerns over the misuse of artificial intelligence tools on social media platforms.
According to officials, the notice was issued after multiple instances of vulgar, indecent and sexually explicit material surfaced online, allegedly generated using Grok. The government has directed X to immediately remove such content and explain the safeguards in place to prevent the misuse of AI-driven features that can violate Indian laws and societal norms.
The ministry has stressed that intermediaries operating in India are legally obligated to comply with the Information Technology Act, 2000, and the IT Rules, 2021. These rules require platforms to ensure that prohibited content, including obscene material, is promptly taken down once identified or flagged. Officials said failure to comply could result in the loss of safe harbour protection under Indian law, exposing the platform to legal action.
Sources indicated that X sought additional time to compile its response, citing the holiday period and operational constraints. The government agreed to grant time until January 7 but made it clear that compliance would be closely monitored. The report is expected to detail the steps taken to remove objectionable content, actions initiated against violators, and technical measures introduced to prevent recurrence.
The issue has reignited a broader debate around the regulation of AI tools and their ethical use, particularly as generative AI becomes more accessible to the public. Experts argue that while AI innovation should be encouraged, platforms must also bear responsibility for ensuring their tools are not used to produce harmful or illegal material.
Government officials reiterated that India remains committed to promoting responsible AI development but will not hesitate to act against platforms that fail to uphold legal and ethical standards in the digital ecosystem.
