UK media regulator Ofcom has launched a formal investigation into Elon Musk’s social media platform X amid concerns that its artificial intelligence tool, Grok, is being used to generate sexualised images, including non-consensual and illegal content.
In a statement, Ofcom said it had received “deeply concerning reports” that the chatbot was being used to create undressed images of individuals without consent, as well as sexualised images involving children.
Potential fines and enforcement measures
If X is found to have breached UK law, Ofcom has the power to impose a fine of up to 10% of the company’s global annual revenue or £18 million, whichever is higher. In extreme cases, the regulator could also seek a court order requiring internet service providers to block access to X entirely within the UK.
X referred questions to a statement previously posted by its Safety account, which said users who prompt Grok to create illegal content would face the same consequences as those who upload illegal material directly.
Elon Musk responded separately by claiming the UK government was seeking “any excuse for censorship,” questioning why other AI platforms were not facing similar scrutiny.
Victims and political reaction
The BBC has reviewed multiple examples of digitally altered images circulating on X in which women were placed into sexual situations without consent. One woman said more than 100 sexualised images had been generated using her likeness.
Technology Secretary Liz Kendall welcomed the investigation and urged Ofcom to act quickly, saying delays would be unacceptable to victims. Former technology secretary Peter Kyle described the situation as “appalling,” citing personal accounts of AI-generated images being used in deeply offensive contexts.
Several MPs have also raised concerns. Northern Ireland politician Cara Hunter said she had decided to leave the platform altogether, while Downing Street said the government’s continued presence on X remains under review, with child protection a key priority.
Focus on illegal content and child safety
Ofcom said the investigation will examine whether X failed to remove illegal content swiftly once it became aware of it, and whether the platform took sufficient steps to prevent UK users from encountering such material.
The regulator will also assess whether X has implemented effective age-assurance measures to prevent children from accessing pornographic imagery.
The move follows international backlash against Grok’s image generation features. Authorities in Malaysia and Indonesia temporarily blocked access to the tool over similar concerns.
Legal experts urge action
Legal scholars said the investigation’s pace is difficult to predict, as Ofcom has discretion over how quickly it proceeds. While the regulator could seek immediate court intervention, experts noted such steps are typically reserved for exceptional circumstances.
Others warned that speculation about blocking X risks distracting from the core issue. Legal experts stressed that the priority must be stopping the creation of illegal images and ensuring victims can have non-consensual content removed quickly.