Musk’s X Curbs Some Deepfake Content, Grok Continues Production

Elon Musk’s social media platform X has made significant changes regarding the use of its Grok artificial intelligence model. These changes come in response to increasing backlash over the generation of sexualized images using AI technology.

Musk’s X Limits Deepfake Content

On X, Grok’s AI image generation functionalities are now exclusive to paying subscribers. This shift particularly affects the generation of sexualized deepfakes, following criticism from users and regulators alike. Despite these limitations, the Grok standalone app and website still allow users to create images that sexualize nonconsenting individuals.

Key Developments

• Grok on X is now available only to premium subscribers.
• Capacities for creating sexualized deepfakes have been restricted on X.
• Users can still generate such content on the Grok app without a paid account.
• Public and regulatory scrutiny prompted these changes on Musk’s platform.

As of early Friday, users noticed a marked decline in the number of sexualized images generated by Grok on X. The platform’s reply bot began informing users that “image generation and editing are currently limited to paying subscribers,” directing them to upgrade their accounts.

Regulatory and Public Backlash

The prior trends indicated an alarming increase in AI-generated sexualized images. An analysis by deepfake researcher Genevieve Oh showed that Grok produced 7,751 sexualized images in just one hour on Wednesday—a 16.4% increase from the previous Monday.

Public figures, including British Prime Minister Keir Starmer, have condemned the proliferation of nonconsensual images. Starmer stated, “This is disgraceful. It’s disgusting. And it’s not to be tolerated,” emphasizing the need for more stringent measures from X.

Regulatory Responses

• The UK’s media regulator Ofcom has engaged with X and xAI to examine compliance and user protection.
• Several international regulatory bodies, including those in Ireland and India, are assessing Grok’s safety issues.
• U.S. lawmakers are pressing for more proactive policies against harmful AI-generated content.

In the U.S., the Justice Department is taking a firm stance against any form of AI-generated child sexual abuse material. While there are calls for action against nonconsensual imagery, a recent law enacted in 2025 aims to hold platforms accountable for such violations.

Future Implications

The recent responses from X reflect an ongoing dilemma regarding privacy, safety, and the ethical implications of AI technology. Legislators and watchdogs are now closely monitoring Grok’s operations, with proposals to reinforce regulatory measures against digital abuse.

As discussions continue about the balance between innovation and ethical standards, the spotlight remains on Musk’s platforms to navigate these complex challenges effectively.