The central government sent a notice to the social media platform ‘X’, directing it to remove obscene content generated by Grok AI. The government has also demanded a report from the company within 72 hours.
For the past few days, there has been a growing misuse of X’s generative AI chatbot, Grok, with users employing it to create obscene content. Concerned by this increasing trend, the Ministry of Electronics and Information Technology (MeitY) has taken strict action, ordering X to immediately review its Grok AI technology.
The government has also instructed X to submit a report on the actions taken and the review conducted within 72 hours. X users were instructing the bot to remove clothing from women’s photos and present them in a more provocative manner.
In several instances, Grok produced altered images of women without their consent, resulting in obscene and manipulated pictures, which violate both the platform’s own policies and Indian laws.
Therefore, the government has now taken action against this trend targeting women. If the platform fails to comply, it could face legal consequences.
In the final weeks of 2023, the Ministry of Electronics and Information Technology (MeitY) issued a new advisory instructing social media platforms to “more strictly adhere” to their obligations to remove obscene, adult, or illegal content. Failure to do so could result in severe penalties for the platforms.
