Friday, January 16, 2026
HomeContentOfcom Launches Formal Probe into X Over Grok AI’s Illegal Content Concerns

Ofcom Launches Formal Probe into X Over Grok AI’s Illegal Content Concerns

The United Kingdom’s independent online safety regulator, Ofcom, has officially opened a formal investigation into the social media platform X (formerly Twitter). The probe focuses on whether the site has breached the UK’s Online Safety Act by failing to protect citizens from illegal and harmful content generated and distributed via its Grok AI chatbot.

Ofcom’s decision follows “deeply concerning” reports that Grok has been used to create non-consensual sexualized imagery of adults and children. These materials, often referred to as “nudification” or intimate image abuse, are considered priority illegal content under UK law. The regulator is specifically investigating claims that the AI tool was used to generate sexualized images of children, which could constitute Child Sexual Abuse Material (CSAM).

The watchdog first contacted X on January 5, 2026, setting a strict deadline of January 9 for the company to explain its safety protocols. After an expedited assessment of the evidence provided by X, Ofcom escalated the matter to a formal inquiry. The investigation will focus on five key pillars of compliance:

  • Risk Assessment: Whether X evaluated the potential for Grok to be used for illegal content before its rollout.
  • Prevention Measures: The effectiveness of steps taken to stop UK users from seeing CSAM and non-consensual deepfakes.
  • Swift Takedowns: Whether X removes illegal content immediately upon awareness.
  • Child Protection: If X conducted specific risk assessments regarding the impact of its AI features on minors.
  • Age Assurance: The use of robust verification to prevent children from accessing pornographic AI outputs.

The UK is part of a growing international wave of regulators targeting X’s AI features. Nations including India, Indonesia, and Malaysia have already initiated investigations, with some regions implementing temporary blocks on the Grok tool.

If found in breach of the Online Safety Act, X faces severe consequences. Ofcom has the authority to:

  1. Require specific platform changes to ensure compliance.
  2. Impose massive fines of up to £18 million or 10% of qualifying worldwide revenue, whichever is higher.
  3. Apply for court-ordered “business disruption measures,” which could force payment providers and advertisers to withdraw services or require ISPs to block access to X in the UK entirely.

Ofcom clarified that its role is not to act as a censor but to ensure platforms have the necessary systems to keep users safe under the law. “Our job is to judge whether sites and apps have taken appropriate steps to protect people,” the regulator stated.

Key Highlights:

  • Formal Probe: Ofcom is investigating X for potentially violating the UK Online Safety Act through Grok AI-generated illegal content.
  • Illegal Material: The focus is on non-consensual “nudified” deepfakes and sexualized images of children (CSAM) created by the chatbot.
  • High Stakes: X could face fines up to 10% of its global revenue or a total ban in the UK if found to be non-compliant.
  • Global Pushback: The UK joins India and several Asian and European nations in scrutinizing X’s AI safety protocols.
1,000FansLike
848FollowersFollow
548SubscribersSubscribe

Related News