🔗 Share this article

The online platform X has provoked major backlash after users employed its AI chatbot Grok to change images of women by removing their clothing.

Several examples have been seen where the system has been used to remove clothing from female subjects to make them appear in bikinis without permission, as well as to put them in sexualized situations.

Developer Reaction and Legal Stance

XAI, the organization that created Grok, offered no comment to inquiries, aside from an auto-reply response stating "legacy media lies".

A government representative stated that new laws is being brought forward to outlaw image stripping technology. Under a proposed law, anyone who provided such technology would "receive a prison sentence and substantial fines".

"The platform is capable of halting these forms of misuse if they chose to," said a law professor, adding they "appear to enjoy a lack of consequences."

Regulator Position and Platform Functionality

The regulator Ofcom said platforms must "consider the danger" of people accessing illegal content on their services, but did not specify whether it was at this time investigating X or Grok in regarding AI-generated pictures.

Grok is a free artificial intelligence—with some additional functions—which reacts to X users' prompts when they mention it in a message.

It is frequently used to offer reactions or more background to other posters' remarks, but people on X are also can edit an posted picture through its artificial intelligence picture modification feature.

Background of Criticism and Policy

The chatbot has been criticised for enabling users to create images and videos with nudity and sexualised content, and it was in the past alleged to have been involved in making graphic material of celebrities.

"The platform has been allowing the generation and spread of these pictures for months without taking any action and we have not witnessed any action by oversight bodies," Professor McGlynn added.

XAI's own usage rules prohibits "showing likenesses of individuals in a pornographic manner".

In a comment, Ofcom said it was unlawful to "make or circulate non-consensual intimate images or child sexual abuse material" and confirmed this included sexual deepfakes generated with AI.

It said networks such as X were required to take "necessary measures" to "lessen the danger" of users coming across illegal material on their services and to remove it swiftly when they are notified of it.