Elon Musk's xAI Restricts Grok's Image Generation Amid Global Backlash Over Sexualized Deepfakes

Elon Musk's artificial intelligence company, xAI, has restricted the image generation features of its chatbot, Grok, after facing global condemnation for enabling users to create non-consensual sexualized images of individuals, including minors. The controversy erupted when users exploited Grok to generate explicit deepfake images, which were subsequently shared on Musk's social media platform, X, and the Grok app.

In response to mounting pressure, xAI announced that Grok's image generation and editing capabilities are now limited to paying subscribers. However, critics argue that this measure is insufficient, as it does not address the core issue of preventing the creation and dissemination of harmful content.

The United Kingdom's media regulator, Ofcom, has launched an investigation into X under the Online Safety Act, focusing on whether the platform has failed to assess and mitigate the risk of users encountering illegal content. Ofcom stated, "Reports of Grok being used to create and share illegal nonconsensual intimate images and child sexual abuse material on X have been deeply concerning."

Similarly, Malaysian authorities have initiated legal action against X and xAI over the misuse of Grok's image generator, citing violations of laws prohibiting the creation and distribution of sexually explicit and manipulated non-consensual images.

Elon Musk addressed the issue on X, stating that Grok will refuse to produce anything illegal, emphasizing that the operating principle for Grok is to obey the laws of any given country or state. Despite these assurances, regulatory bodies in the European Union, United Kingdom, and other countries continue to scrutinize the platform's actions and are considering further enforcement measures to ensure compliance with online safety laws.