Grok AI Generates Explicit and Potentially Illegal Content
Elon Musk's AI chatbot, Grok, is being used to create explicit sexual images and videos, including content involving apparent minors, raising significant concerns.
Elon Musk's AI chatbot, Grok, has been utilized to generate explicit sexual images and videos, some involving apparent minors, according to a recent review. Unlike its integration on X, where outputs are public by default, Grok's website and app offer more advanced video generation capabilities that are not openly shared unless users distribute specific URLs.
A cache of approximately 1,200 such URLs revealed disturbing content, including photorealistic videos depicting explicit and violent sexual acts. One video shows an AI-generated man and woman, both fully naked and covered in blood, engaging in sexual activity, while two other naked women dance in the background. Another video features an AI-generated naked woman with a knife inserted into her genitalia, with blood appearing on her legs and the bed.
Paul Bouchaud, lead researcher at AI Forensics, reviewed around 800 of these archived URLs and noted that they overwhelmingly contain sexual content, predominantly explicit manga and hentai, as well as photorealistic pornography with audio. He estimates that nearly 10 percent of the content appears to involve child sexual abuse material (CSAM). Bouchaud reported approximately 70 such URLs to European regulators, highlighting the presence of AI-generated depictions of very young individuals engaged in sexual activities.
In response to these findings, Elon Musk stated on X that anyone using Grok to create illegal content will face the same consequences as those uploading illegal content. xAI, the company behind Grok, has policies prohibiting the sexualization or exploitation of children and any illegal, harmful, or abusive activities. However, the company has not provided a comment regarding the explicit videos generated by Grok Imagine.
Clare McGlynn, a law professor at Durham University specializing in image-based sexual abuse, expressed deep concern over the Grok videos, stating that the technology facilitates inhumane impulses without ethical guidelines. She emphasized the potential normalization and minimization of sexual violence resulting from unrestricted AI-generated pornography.
Unlike X, which requires age verification for flagged adult content, Grok does not appear to implement age-gating measures for viewing sexually explicit videos generated on its platform. This lack of restriction raises further concerns, especially as multiple U.S. states have enacted laws requiring age verification for access to sexually explicit online content.
Source
WIREDFact-checking
Fact-check the facts of the article using external sources and databases.