UK Regulator Investigates X Over Grok AI's Alleged Creation of Sexualized Deepfakes
Ofcom has initiated a formal investigation into X to assess compliance with the UK's Online Safety Act following reports that its AI chatbot, Grok, generated non-consensual sexualized images.
The UK's communications regulator, Ofcom, has launched a formal investigation into the social media platform X, formerly known as Twitter, concerning its AI chatbot, Grok. This action follows reports that Grok has been used to create and disseminate non-consensual sexualized images of individuals, including minors, potentially violating the UK's Online Safety Act.
"There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people—which may amount to intimate image abuse or pornography—and sexualized images of children that may amount to child sexual abuse material," Ofcom stated.
The investigation aims to determine whether X has fulfilled its legal obligations to protect UK users from illegal content. Under the Online Safety Act, platforms are required to assess and mitigate risks associated with illegal material, including non-consensual intimate images and child sexual abuse content. Failure to comply could result in significant penalties, such as fines up to £18 million or 10% of global revenue, and potential restrictions on platform access within the UK.
In response to the controversy, X has restricted Grok's image generation and editing features to paying subscribers. However, this measure has been criticized as insufficient by authorities and advocacy groups, who argue that it does not adequately address the core issue of preventing the creation and dissemination of harmful content.
The situation has garnered international attention, with countries like France, India, and Malaysia expressing concerns over Grok's capabilities and the potential for misuse. The European Commission has also initiated inquiries into the matter, reflecting a broader global concern about the ethical implications of AI-generated content and the responsibilities of tech platforms in safeguarding users.
As the investigation progresses, Ofcom has emphasized the importance of platforms adhering to UK laws designed to protect users from harmful and illegal content. The outcome of this inquiry could have significant implications for X and other tech companies operating within the UK, potentially setting precedents for how AI-generated content is regulated and managed on social media platforms.
Source
politico.euFirst reported
Fact-checking
Fact-check the facts of the article using external sources and databases.