The British government is advancing legislation aimed at deeming the creation of sexualized images without consent, especially those generated by artificial intelligence such as Grok—the chatbot integrated into Elon Musk’s social media platform, X—as criminal offenses. This move emerges in response to a recent scandal involving an influx of deepfake content on the platform over recent weeks.
Technology Secretary Liz Kendal declared in a House of Commons session on Monday that individuals engaged in producing or attempting to produce such non-consensual sexual imagery, including on X, would be committing a prosecutable crime. Kendal further detailed the government’s intention to criminalize entities that supply technological means to facilitate the creation of these illicit images, signaling a broad approach targeting both creators and distributors of these AI-generated materials.
This policy action coincided closely with an announcement from the Office of Communications (Ofcom), the independent U.K. communications regulator, indicating it would launch an investigation into X. Concerns center around the thousands of explicit images produced via Grok that have saturated the platform recently, notably including sexualized portrayals seemingly involving minors. The inquiry’s primary focus will assess potential infringements of the U.K.'s Online Safety Act (OSA) by these deepfake images.
Moreover, Kendal expressed firm governmental backing for Ofcom’s potential use of powers to restrict access to X within the country should that become necessary to enforce compliance. This position reflects the seriousness with which authorities are addressing the proliferation of offensive AI-generated content.
In a reactive measure last Friday, X imposed new limitations on Grok’s image generation and editing features, confining these capabilities exclusively to paid subscribers. However, Kendal criticized this step as inadequate, arguing that permitting such content through a subscription model still undermines victims by commodifying abuse rather than preventing it.
Explore further: Grok deepfake controversy, explained
Kendal conveyed her disapproval during parliamentary discussions, stating, “It is insulting to victims to say you can still have this service if you are willing to pay,” and underscored the problematic nature of monetizing harmful content.
Musk’s Response to the Deepfake Issue
Elon Musk launched Grok’s “Spicy Mode” feature last summer, enabling the chatbot to generate adult-themed content. The platform professes a commitment to combating unlawful materials, including child sexual abuse content (CSAM), through removal mechanisms, account suspensions, and collaborations with governmental and law enforcement bodies.
Despite these purported safeguards, users of X have exploited Grok’s image-generation capabilities since late December to modify photographs posted by individuals—including creating non-consensual undressing effects—resulting in widespread problematic imagery.
Musk’s public remarks in response to criticism have not shown contrition. Instead, he has framed detractors as advocates for censorship, questioning the British government’s approach by describing it as “fascist.” For example, on January 10, Musk posted on X a disparaging query about the U.K. government alongside an AI-generated image of Prime Minister Keir Starmer depicted in a bikini.
X did not provide comment for further inquiry.
International and Governmental Reactions
The United Kingdom is not alone in intensifying federal-level actions concerning AI-generated explicit imagery on social media platforms. Over the course of a weekend, Malaysia and Indonesia proactively blocked access to Grok within their jurisdictions, marking the first global instances of such regulatory interdictions.
Authorities in these Southeast Asian nations cited insufficient existing safeguards on the app, emphasizing the urgent need to prevent the dissemination of non-consensual sexual deepfake content targeting women and children.
Indonesia's Minister of Communication and Digital Affairs, Meutya Hafid, condemned these deepfakes as severe violations of human rights, dignity, and digital safety for citizens.
Similarly, officials in countries including France and India have publicly denounced the use of Grok for creating objectionable imagery and encouraged regulators and legislators to investigate X’s practices. Early January reports indicate the European Commission is seriously evaluating the issue, with representatives branding the content as illegal and unacceptable within Europe.
Free Speech and Regulatory Tensions
The newly introduced U.K. legislation risks sparking intensified debates between the United States and the United Kingdom regarding free speech boundaries. Vice President J.D. Vance has repeatedly criticized European free speech frameworks over the previous year, asserting they represent a retreat from foundational rights.
Vance openly challenged Prime Minister Starmer during a U.S. visit in February over the U.K.’s online speech policies, claiming these laws imperil not only British freedom but also the interests of American technology firms and citizens.
Starmer countered by affirming the U.K.’s longstanding tradition of free speech, emphasizing its endurance and resilience.
This U.K. crackdown on Grok and its related content controversies arrives amidst ongoing tensions between the U.S., the U.K., and the European Union concerning AI governance, social media regulations, and digital freedoms.
Meanwhile, in the United States, the Trump Administration has displayed receptivity to AI technologies like Grok as evidenced by a recent partnership announcement with the Pentagon. Donald Trump has also shown signs of reconciliation with Elon Musk, despite a prior public dispute, praising Musk’s intelligence and character in recent statements and appealing for his assistance in providing internet access to Iran via Musk’s Starlink satellite network.
Trump remarked on January 4 that Musk is “80% super genius, and 20% he makes mistakes,” characterizing him as fundamentally well-intentioned.