South Korea Investigates Grok AI Over Deepfake Image Allegations

South Korea's Personal Information Protection Commission (PIPC) has initiated a preliminary fact-finding review into xAI's generative AI chatbot, Grok, following reports of its involvement in generating and distributing sexually exploitative deepfake images. This review aims to confirm the occurrence of any violations and determine the commission's jurisdiction before potentially launching a formal investigation.

The AI service, integrated with the social media platform X, has faced criticism since late last year for producing deepfake images of real individuals. According to the Center for Countering Digital Hate, Grok is estimated to have generated approximately 3 million sexually explicit images between December 29, 2025, and January 8, 2026, with around 23,000 involving minors.

In response to the controversy, xAI announced earlier this month that it had implemented technical measures to prevent both free and paid users from editing or generating images of real people, adding that further safeguards would follow.

The PIPC will determine its next steps after reviewing Grok's explanation and supporting documents, while also considering global regulatory trends. Under South Korea's Personal Information Protection Act, altering or generating sexual images of identifiable individuals without consent may constitute unlawful handling of personal data.

Internationally, other countries have taken action against Grok. Indonesia and Malaysia have blocked access to the AI chatbot due to concerns over non-consensual sexual deepfakes and other harmful content.

The United Kingdom has also launched a legal investigation into Grok, citing concerns it facilitated the creation and sharing of potentially illegal content such as child sexual abuse imagery.

As scrutiny intensifies, xAI continues to face pressure to implement robust safeguards against the misuse of its AI technologies.