UK media regulator Ofcom has made âurgent contactâ with xAI, the artificial intelligence business owned by Elon Musk, following reports that its Grok chatbot can be used to generate sexualised images of children and non-consensual explicit images of women.
The intervention follows widespread concern over Grokâs image-generation capabilities on X, where users have posted examples of the AI being prompted to digitally âundressâ women or place them into sexualised scenarios without consent.
Ofcom confirmed it is investigating whether the use of Grok breaches the UKâs Online Safety Act, which makes it illegal to create or share intimate or sexually explicit images, including AI-generated âdeepfakesâ, without a personâs consent.
A spokesperson for Ofcom said the regulator is also examining allegations that Grok has been producing âundressed imagesâ of individuals, adding that technology companies are legally required to take appropriate steps to prevent UK users from encountering illegal content and to remove such material swiftly once flagged.
X has not responded publicly to Ofcomâs request for clarification. However, over the weekend the platform issued a warning to users not to use Grok to generate illegal material, including child sexual abuse imagery. Musk also posted on X that anyone prompting Grok to create illegal content would âsuffer the same consequencesâ as if they had uploaded such content themselves.
Despite this, Grokâs own acceptable use policy, which explicitly bans depicting real people in a pornographic manner, appears to have been routinely bypassed. Images of high-profile figures, including Catherine, Princess of Wales, were among those reportedly manipulated using the AI tool.
The Internet Watch Foundation confirmed it has received reports from members of the public relating to Grok-generated images. However, it said that, so far, it had not identified content that crossed the legal threshold to be classified as child sexual abuse material under UK law.
The issue has also triggered scrutiny beyond the UK. The European Commission said it was âseriously looking into the matterâ, while regulators in France, Malaysia and India are reportedly assessing whether Grok breaches local laws.
Thomas Regnier, a European Commission spokesperson, described the content as âappallingâ and âdisgustingâ, stating that there was âno placeâ for such material in Europe. X was fined âŹ120 million (ÂŁ104 million) by EU regulators in December for breaching its obligations under the Digital Services Act.
Criticism has intensified from UK politicians. Dame Chi Onwurah, chair of the Science, Innovation and Technology Committee, said the allegations were âdeeply disturbingâ and argued that existing safeguards were failing to protect the public. She described the Online Safety Act as âwoefully inadequateâ and called for stronger enforcement powers against social media platforms.
The controversy has also highlighted the human impact of AI misuse. Journalist Samantha Smith told the BBC that seeing AI-generated images of herself in a bikini was âas violating as if someone had posted a real explicit imageâ.
âIt looked like me. It felt like me. And it was dehumanising,â she said.
The Home Office confirmed it is progressing legislation to outlaw ânudificationâ tools altogether, with a proposed new criminal offence that would see suppliers of such technology face prison sentences and substantial fines.
As regulators move to tighten scrutiny, the Grok episode has become a flashpoint in the wider debate over AI accountability, platform responsibility and the limits of free expression in the age of generative technology.
Read more:
Ofcom demands answers from X over claims Grok AI generates sexualised images of children
