Elon Musk’s artificial intelligence venture, xAI, is facing mounting criticism worldwide after its chatbot Grok was found to be producing sexually suggestive manipulated images of women and children, raising serious concerns about consent, safety and regulatory oversight.
The issue surfaced when users on X discovered that Grok’s image-editing feature could be used to alter real photographs by digitally changing clothing or generating provocative versions of the images. By tagging Grok directly under posts, users were able to receive highly realistic edited images within minutes.
From experimental tool to widespread abuse
Although similar image-altering AI services have existed on fringe platforms in the past, Grok’s direct integration with a major social media network marked a turning point. The tool was freely accessible and required no external websites, allowing misuse to spread rapidly and publicly.
Alarm escalated when the chatbot was reportedly used to generate sexualised images involving minors. In some instances, users manipulated photos of women who had died in tragic incidents, further fuelling public anger and ethical concerns.
An independent review conducted by Paris-based organisation AI Forensics analysed more than 20,000 images created through Grok. The assessment found that a majority showed individuals in revealing attire, predominantly women, while a small but significant percentage appeared to involve underage subjects.
Governments’ action across continents
Several governments moved quickly in response. Indonesia became the first country to completely block access to Grok, with Malaysia implementing similar restrictions shortly afterwards.
Indian authorities confirmed that X removed thousands of posts and disabled hundreds of user accounts following official objections. A government source said approximately 3,500 posts and 600 accounts were taken down.
In the United Kingdom, media regulator Ofcom has initiated an investigation into whether X breached national laws governing harmful online content. Prime Minister Keir Starmer warned that the government would act decisively if the platform failed to prevent further misuse.
France also escalated the matter. The country’s commissioner for children referred the case to prosecutors, media regulators and European Union institutions. French digital officials criticised xAI’s decision to restrict image generation to paid users, describing the move as inadequate.
At the European level, the European Commission instructed X to preserve all internal data linked to Grok until the end of 2026. The platform has already been under scrutiny since 2023 over potential violations of EU digital regulations. Commission President Ursula von der Leyen said protecting children and personal dignity could not be left solely to technology companies.
X’s AI and Musk respond
X’s safety team said it was removing illegal content, permanently suspending offending accounts and cooperating with law enforcement agencies.
Elon Musk stated that individuals using Grok to create unlawful material would face the same consequences as those posting illegal content directly.
However, Musk drew criticism after sharing a light-hearted post related to the controversy, which many viewed as dismissive. By January 9, Grok stopped fulfilling image-generation and editing requests for non-paying users.
Musk later rejected political criticism, arguing that opponents were using the incident to justify restrictions on free expression.
The episode has intensified global debate over the ethical boundaries of artificial intelligence, platform accountability and the urgent need for stronger safeguards to prevent abuse of emerging technologies.
