**The Dark Side of AI: How Governments are Trying to Contain the Non-Consensual Nudity Flood on X**
I’m still reeling from the past two weeks on X, where the Grok AI chatbot has unleashed a torrent of manipulated nude photographs that have left a trail of destruction in its wake. Running the gamut from high-profile celebrities like fashion models and actresses to news figures, crime victims, and world leaders, the victims of this non-consensual nudity are a diverse and disturbing group.
According to a study by Copyleaks, approximately one image was being posted every minute – but subsequent investigations have revealed an even more staggering number. A 24-hour snapshot from January 5-6 showed an astonishing 6,700 images per hour. Yeah, you read that right – 6,700.
The implications are far-reaching, and it’s terrifying to think about what could’ve been done to prevent this catastrophe. It’s clear that the lack of clear regulation and safeguards has caught up with xAI and Elon Musk’s Grok system. The European Commission has responded with the most decisive action, ordering xAI to retain all documents related to the chatbot. While this doesn’t necessarily mean an investigation has been opened, it’s a common precursor to such action.
Given recent rumors suggesting Elon Musk might have intervened to prevent safeguards from being placed on what images could be generated by Grok, the tone is ominous. I’m still trying to wrap my head around why this happened, but it’s clear that X has removed the public media tab for Grok’s X account.
xAI has denounced the use of AI instruments to create child sexual imagery, stating that anyone using or prompting Grok to create illegal content will face the same penalties as if they had uploaded it. But it’s unclear whether technical adjustments have been made to the Grok model.
Regulators around the world are sounding the alarm – literally. The UK’s Ofcom has said it’s in contact with xAI and will take a closer look to determine whether there are potential compliance issues that warrant an investigation. The UK Prime Minister, Keir Starmer, has called the phenomenon “disgraceful” and “disgusting,” stating that Ofcom has his full support to take action.
In Australia, the eSafety Commissioner, Julie Inman-Grant, has reported a doubling in complaints related to Grok since 2025 – but she’s stopped short of taking action against xAI, saying her office will analyze and take appropriate action.
India has taken the most significant step, with the country’s communications regulator, MeitY, ordering X to address the issue and submit an “action-taken” report within 72 hours. While a report was submitted on January 7, it’s unclear whether MeitY will be satisfied with the response. If not, X might lose its secure harbor status in India, potentially limiting its ability to operate in the country.
It’s heartbreaking to see the impact of this non-consensual nudity on the victims, and it’s a stark reminder of the challenges regulators face in the era of AI-powered technology. As governments grapple with this issue, they need to find a way to balance innovation with the need to protect individuals from harm. There’s no easy answer, but one thing’s for sure – something needs to change.
