The UK authority takes action following users prompting AI to generate sexually explicit deepfakes, raising concerns about the extensive misuse of images on the platform.
The UK’s media authority initiated an inquiry on Monday to assess if explicit deepfake videos created by Elon Musk’s X platform’s Grok AI chatbot breached its responsibility to safeguard individuals in the UK from potentially unlawful content.
“There are serious reports about the Grok AI chatbot account on X being utilized to generate and distribute images of people without clothing – which could constitute intimate image abuse or pornography – as well as sexually explicit images of children that might be classified as child sexual abuse material,” Ofcom stated in a release.
The authority faces mounting pressure to take action following Prime Minister Keir Starmer’s description of the images generated by Grok as “revolting” and “illegal”.
Are you curious about the major issues and global trends? Find the solutions withSCMP Knowledge, our latest platform offering handpicked content including explainers, FAQs, analyses, and infographics, presented by our acclaimed team.
Musk’s X needed to “regain control” of Grok, Starmer stated on Thursday, noting that Ofcom has the government’s complete backing to act.
Producing or distributing non-consensual intimate images or child sexual abuse content, including AI-created sexual material, is against the law in the UK.
Furthermore, technology companies should ensure that British users do not come across unlawful material and should delete it promptly upon discovering it.
One example is Julie Yukari, a musician based in Rio de Janeiro. Following the posting of an image of herself in a red dress on New Year’s Eve, she found that individuals were instructing Grok to digitally remove her clothing. Grok did so, and almost nude pictures of her quickly began spreading across the platform.
“I was inexperienced,” Yukari said to Reuters, mentioning that she initially believed the bot would prevent such requests.
X has been criticized in various countries regarding this feature, which can generate images of women and children wearing revealing attire.
French officials have informed prosecutors and regulators about X, describing the material as “clearly unlawful,” while Indian authorities have also requested clarifications.
X has limited the feature to paid users. It stated last week that it removes all illegal content from the platform and permanently bans involved accounts.
“Anyone who uses or encourages Grok to generate illegal content will face the same repercussions as if they had uploaded such material,” it stated.
When asked about the topic recently, xAI stated: “Legacy Media Lies.”
Ofcom will look into whether X did not evaluate the possibility that individuals in the UK might encounter illegal content, and whether it took into account the potential risk to children.
Ofcom stated that in the most severe instances of violation, it might request a court to compel “payment providers or advertisers to cease their services on a platform,” or have internet service providers restrict access to a website within the UK.
X did not promptly respond to an invitation to provide comments on the Ofcom inquiry.
More Articles from SCMP
Hong Kong Legislative Council president forms a team of coordinators to enhance productivity
With Trump warning of strikes against Iran, China criticizes the use of violence in the Middle East
This piece was first published in the South China Morning Post (www.scmp.com), a top news outlet covering China and Asia.
Copyright (c) 2026. South China Morning Post Publishers Ltd. All rights reserved.
jasdooit 
Leave a comment