Ofcom Investigates X Over Grok AI's Generation of Sexualised Images

The UK's media regulator, Ofcom, has launched a formal investigation into X's AI chatbot, Grok, amid reports that it has been used to generate and disseminate non-consensual intimate images and sexualised depictions of children. Ofcom stated that such content may constitute intimate image abuse or child sexual abuse material, both of which are illegal in the UK.

"There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people – which may amount to intimate image abuse or pornography – and sexualised images of children that may amount to child sexual abuse material," Ofcom said in a statement.

The investigation will assess whether X has fulfilled its legal obligations under the Online Safety Act, including evaluating the risk of UK users encountering illegal content and implementing measures to prevent such exposure. Potential penalties for non-compliance include fines up to £18 million or 10% of global revenue, whichever is greater. In severe cases, Ofcom may seek court orders to restrict access to the platform within the UK.

Technology Secretary Liz Kendall welcomed the investigation, emphasizing the need for swift action to protect the public and victims. She stated, "It is vital that Ofcom complete this investigation swiftly because the public – and most importantly the victims – will not accept any delay."

X has faced international scrutiny over Grok's capabilities. Malaysia and Indonesia recently blocked access to the chatbot due to concerns over its misuse in generating non-consensual explicit images. In response to the backlash, X restricted Grok's image generation features to paying subscribers, though authorities argue this measure is insufficient.

Elon Musk, owner of X, commented on the situation, stating that "anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content." X's official Safety account reiterated their commitment to removing illegal content and cooperating with law enforcement.

Ofcom has not specified a timeline for the investigation but emphasized its priority status. A spokesperson stated, "We won't hesitate to investigate where we suspect companies are failing in their duties, especially where there's a risk of harm to children."

The outcome of this investigation could have significant implications for AI-generated content and platform responsibilities in the UK and beyond.