IWF Identifies AI-Generated Child Sexual Imagery Linked to Grok

The Internet Watch Foundation (IWF) has identified AI-generated sexualized images of girls aged 11 to 13, reportedly created using Grok, an AI tool developed by xAI, a company owned by Elon Musk. These images were found on a dark web forum where users claimed to have utilized Grok for their creation.

IWF analyst Ngaire Alexander expressed concern over the ease and speed with which individuals can generate photo-realistic child sexual abuse material (CSAM) using such tools. He noted that the material would be classified as Category C under UK law, indicating the lowest severity of criminal material. However, the user who uploaded it had subsequently used a different AI tool to create a Category A image, representing the most serious category.

The IWF, dedicated to removing child sexual abuse material from the internet, operates a hotline for reporting suspected CSAM and employs analysts to assess the legality and severity of such content. The organization found the material on the dark web; the images were not discovered on the social media platform X.

Previously, X and xAI were contacted by Ofcom following reports that Grok could be used to create sexualized images of children and undress women. X stated: "We take action against illegal content on X, including CSAM, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary. Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content."