The online network X has sparked major outrage after people used its AI chatbot Grok to change photos of women by stripping their clothing.
Numerous examples have emerged where the technology has been employed to virtually strip women to make them appear in swimwear without permission, as well as to insert them in inappropriate contexts.
Developer Reaction and Regulatory Stance
XAI, the firm behind Grok, remained silent to questions, except for an standard message stating "traditional news outlets lies".
A Home Office spokesperson stated that legislation is being introduced to prohibit nudification tools. Under a upcoming criminal offence, anyone who supplied such tools would "be subject to a prison sentence and heavy penalties".
"X or Grok is capable of halting these forms of misuse if they chose to," said Clare McGlynn, adding they "appear to enjoy impunity."
Regulator Position and Tool Functionality
The regulator Ofcom said platforms must "evaluate the risk" of people viewing illegal content on their networks, but did not confirm whether it was presently investigating X or Grok in relation to artificial intelligence pictures.
Grok is a free artificial intelligence—with some paid-for features—which reacts to X users' requests when they reference it in a tweet.
It is frequently used to provide commentary or additional background to other users' remarks, but people on X are also capable of modify an uploaded photo through its artificial intelligence picture modification function.
Background of Criticism and Rules
The system has been faulted for permitting users to produce photos and clips with nudity and sexually suggestive material, and it was in the past accused of creating graphic material of public figures.
"X has been permitting the generation and spread of these pictures for months without taking any steps and we have yet to see any challenge by oversight bodies," the expert added.
XAI's own acceptable use policy prohibits "portraying likenesses of individuals in a graphic manner".
In a statement, Ofcom said it was unlawful to "create or distribute private pictures or illegal content" and confirmed this included sexual deepfakes made with AI.
It said networks such as X were mandated to take "appropriate steps" to "reduce the risk" of users viewing unlawful material on their services and to delete it quickly when they become aware of it.
