The UK media watchdog has confirmed that it has opened a formal investigation into Elon Musk’s X over the use of the Grok AI tool to manipulate real images of women and children by removing their clothes and placing them in sexual poses.
Ofcom has acted following a public and political outcry, including demands for an investigation from PM Keir Starmer, over a deluge of sexual images appearing on the platform, created by Musk’s Grok, which is now integrated with X.
The regulator is investigating X under the Online Safety Act (OSA), which carries a range of possible punishments for breaches, including fines of up to 10% of global revenue right up to an outright UK ban of apps and websites for the most serious abuses. It said it would pursue the investigation as a “matter of the highest priority”.
Ofcom said in a statement: “Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning. Platforms must protect people in the UK from content that’s illegal in the UK, and we won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children.
“We’ll progress this investigation as a matter of the highest priority, while ensuring we follow due process. As the UK’s independent online safety enforcement agency, it’s important we make sure our investigations are legally robust and fairly decided.”
READ MORE: Nanoco files counterclaims as quantum dot firm digs in for latest IP battle
Sharing intimate image abuse online is illegal under the OSA, which also requires that pornography is age registricted. Companies are also required to have systems in place to prevent child sexual abuse material (CSAM) from appearing, and take it down quickly if it ever is posted on a platform.
Ofcom said it had “urgently” made contact with X about its concerns last Monday. Having considered X’s response about the steps it has taken to comply with the act – essentially restricting clothes removal and porn generation ability to premium members only – Ofcom said it had opened a formal investigation after an “expedited” assessment carried out as a “matter of urgency”.
The watchdog is focusing on whether X has breached the act in several ways:
- Failing to assess the risk of people seeing illegal content on the platform
- Not taking appropriate steps to prevent users from viewing illegal content such as intimate image abuse and CSAM
- Not taking down illegal material quickly
- Not protecting users from breaches of privacy law
- Failing to assess the risk X may pose to children; not using effective age checking for pornography.
Grok has been integrated into X, and an update of the AI tool has allowed users to prompt it to alter clothed images of women and children by making them appear in bikinis and sexually suggestive poses.
The government has already said that it would support Ofcom if it decided X should be effectively banned, prompting a storm of freedom of speech accusations from right wingers on both sides of the Atlantic, not least from former Reform and now independent MP Rupert Lowe and professional rabble rouser and self-proclaimed protector of women and children Tommy Robinson (real name Steven Yaxley-Lennon), who have threatened to fight any such ban “on the streets.” Across the pond, Republican Congresswoman and ally of Donald Trump Anna Paulina Luna said she was drafting legislation that would allow the US to sanction the UK if it bans or restricts X under the Online Safety Act, labelling such a possible move as “a political war against Elon Musk and free speech.”
Ofcom said it would gather evidence on whether a breach had occurred. If it decides a breach has taken place it will announce this in a provisional decision before making a final ruling. The regulator did not give details on how long the investigation might take.
