Podcast Episode
An Ofcom spokesperson said on Sunday that their formal investigation remains ongoing. We are working around the clock to progress this and get answers into what went wrong and what's being done to fix it. The statement came days after xAI implemented restrictions that block Grok from editing images of real people into revealing clothing globally.
Technology Secretary Liz Kendall has backed the regulator's scrutiny, warning that platforms failing to comply with UK law could face severe consequences. The Online Safety Act includes the power to block services from being accessed in the UK, if they refuse to comply with UK law. If Ofcom decide to use those powers they will have our full support, Kendall said in a statement.
On January 15, xAI announced broader restrictions, implementing geoblocking to prevent users from creating images of real individuals in bikinis, underwear, or similar attire in jurisdictions where such content is illegal. The company's safety team wrote on X that they have implemented technological measures to prevent the Grok account on X globally from allowing the editing of images of real people in revealing clothing such as bikinis.
When asked whether X could be banned, Business Secretary Peter Kyle said yes, of course, but noted that the power to do so lay with Ofcom.
UK Regulator Launches Formal Investigation Into Grok AI Over Deepfake Concerns
January 20, 2026
Audio archived. Episodes older than 60 days are removed to save server storage. Story details remain below.
British regulators have confirmed they are continuing a formal investigation into Elon Musk's AI chatbot Grok, dismissing recent safety measures from xAI as insufficient to address concerns about sexually explicit deepfakes generated on the platform. The probe, launched on January 12, 2026, marks the first significant enforcement action under the UK's Online Safety Act targeting a major social media platform.
The Investigation
UK media regulator Ofcom opened its investigation after reports emerged that Grok was being used to create and distribute sexualised deepfake images. According to Ofcom's statement, the investigation focuses on whether content generated by Grok violates the Online Safety Act 2023, specifically examining reports that the AI chatbot created and shared undressed images of people, which may amount to intimate image abuse or pornography, and sexualised images of children that may amount to child sexual abuse material.An Ofcom spokesperson said on Sunday that their formal investigation remains ongoing. We are working around the clock to progress this and get answers into what went wrong and what's being done to fix it. The statement came days after xAI implemented restrictions that block Grok from editing images of real people into revealing clothing globally.
Potential Penalties
If found in violation, X could face severe consequences. The platform faces fines of up to 10 percent of its global revenue or 18 million pounds, whichever is higher. In extreme cases, Ofcom could seek a court order to block the platform entirely in Britain.Technology Secretary Liz Kendall has backed the regulator's scrutiny, warning that platforms failing to comply with UK law could face severe consequences. The Online Safety Act includes the power to block services from being accessed in the UK, if they refuse to comply with UK law. If Ofcom decide to use those powers they will have our full support, Kendall said in a statement.
xAI's Response and Political Backlash
xAI's initial response, limiting Grok's image generation to paid subscribers on January 9, drew sharp criticism from British officials. Prime Minister Keir Starmer's spokesperson called the move insulting to victims of sexual violence, arguing it simply turns an AI feature that allows the creation of unlawful images into a premium service.On January 15, xAI announced broader restrictions, implementing geoblocking to prevent users from creating images of real individuals in bikinis, underwear, or similar attire in jurisdictions where such content is illegal. The company's safety team wrote on X that they have implemented technological measures to prevent the Grok account on X globally from allowing the editing of images of real people in revealing clothing such as bikinis.
Research Findings
An analysis by AI Forensics, a European nonprofit, examined more than 20,000 images generated by Grok and found that 53 percent depicted individuals in minimal attire, with 81 percent of those being women. Approximately 2 percent appeared to show minors, while 6 percent depicted public figures.International Response
Britain is part of a growing coalition of nations taking action against Grok. California Attorney General Rob Bonta announced an investigation on January 13, citing concerns that xAI appears to be facilitating the large scale production of deepfake nonconsensual intimate images. Malaysia and Indonesia temporarily blocked Grok access over the weekend of January 11 and 12, while France and India have launched their own inquiries.Free Speech Debate
Despite Musk's characterisation of UK criticism as seeking any excuse for censorship, Kendall has rejected claims that the crackdown targets free speech. This is not about limiting freedom of speech, she told Parliament. It is about addressing violence against women and girls.When asked whether X could be banned, Business Secretary Peter Kyle said yes, of course, but noted that the power to do so lay with Ofcom.
Implications for AI Regulation
The investigation represents a significant test case for how governments worldwide will regulate AI generated content, particularly when it comes to preventing the creation of nonconsensual intimate images. The outcome could set important precedents for how AI platforms are held accountable for content created by their tools and the adequacy of safety measures implemented by technology companies.Published January 20, 2026 at 4:36am
