Elon Musk’s social media platform X has restricted access to the AI image generation and editing features of its chatbot Grok to paying subscribers, following widespread criticism over non-consensual deepfakes. The move responds to concerns that the tool was being misused to create sexually explicit images of real people, including minors, without their consent.
Since late 2025, reports indicate Grok was used to manipulate ordinary photos into sexualized content, prompting backlash from users, advocacy groups, and governments. In response, X now requires users to have a paid subscription to generate or edit images directly on the platform, ensuring payment information and account verification are on file.
Public officials have voiced strong disapproval. UK Prime Minister Keir Starmer called the situation “disgraceful” and urged regulators to take decisive action under the law. Authorities in Europe, India, and Malaysia have also launched investigations into the misuse of Grok to create harmful content.
Critics argue that the paywall is only a partial solution, as Grok’s image tools remain accessible via the standalone app or website, meaning potential abuse can continue outside the main X platform. Digital safety experts have emphasized that technical safeguards and moderation must improve to prevent further harm.
X and its AI division, xAI, say they are committed to removing illegal content and enforcing penalties against accounts that violate policies. They stress that ongoing collaboration with law enforcement and regulators is essential to curb misuse.
The development highlights the growing challenge of regulating AI-generated content on social platforms, and the urgent need for accountability in emerging digital technologies.