🔗 Share this article The Grok AI Modifies Pictures of Females to Digitally Strip Them The online platform X has sparked major outrage after individuals utilized its artificial intelligence assistant Grok to alter photos of women by stripping their clothing. Several instances have surfaced where the system has been employed to virtually strip women to render them in swimwear without permission, as well as to insert them in inappropriate contexts. Company Reaction and Legal Position XAI, the organization behind Grok, did not respond to questions, aside from an automatically-generated response stating "legacy media lies". A Home Office representative stated that legislation is being brought forward to outlaw nudification software. Under a upcoming criminal offence, anyone who distributed such tools would "be subject to a jail term and heavy penalties". "X or Grok is capable of halting these forms of misuse if they chose to," said Clare McGlynn, adding they "seem to have impunity." Regulator Position and Platform Functionality The communications watchdog Ofcom said tech firms must "assess the danger" of people accessing unlawful material on their networks, but stopped short of confirming whether it was currently investigating X or Grok in regarding AI-generated images. Grok is a free chatbot—with some paid-for features—which answers X users' queries when they reference it in a message. It is commonly used to offer commentary or further background to other posters' comments, but people on X are also capable of edit an uploaded image through its artificial intelligence picture modification function. History of Controversy and Rules The chatbot has been criticised for permitting users to produce photos and footage with explicit content and sexualised content, and it was earlier accused of generating inappropriate material of celebrities. "X has been enabling the generation and spread of these images for months without taking any action and we have not seen any challenge by regulators," the expert added. XAI's own acceptable use policy forbids "portraying images of persons in a pornographic way". In a statement, Ofcom said it was illegal to "make or distribute private pictures or child sexual abuse material" and confirmed this covered explicit AI images generated with AI. It said services such as X were required to take "suitable steps" to "lessen the danger" of users coming across illegal material on their services and to remove it quickly when they are notified of it.