MAP Forum

Following worldwide pressure including bans in certain countries, Elon Musk's X has announced it will no longer allow Grok to create child porn and deepfake nudes. There is a catch.

Users of Musk's AI tool Grok has been taking real-life photographs of women and children, and having it generate images that are pornographic. Musk originally described it as "way funnier," then later insisted that it was simply never happening — after he made it a paid premium feature.

When we were looking into it, it took less than 10 seconds to find illegal content on X, generated by Grok. After Musk monetized the illegal porn generation, it took about 30 seconds, so it wasn't that effective a countermeasure.

There are hundreds of open investigations into content shared on X, a senior Irish police officer has said, amid concerns over potential child sexual abuse material (CSAM) generated on the platform using the artificial intelligence tool Grok.

Irish politicians convened on Wednesday for an Oireachtas Media Committee hearing with Irish police and other experts which largely dealt with growing concerns over the proliferation of CSAM and other AI-generated sexualised material on the social network formerly known as Twitter.

X is no longer a normal social-media platform, said Cédric Wermuth, co-president of the Swiss Socialist Party, reported RTS. The party says it will submit a parliamentary motion on the subject unless the federal government and parliament withdraw from the platform.

The Paris prosecutor's cybercrime unit raided the French offices of Elon Musk's social media platform X on Tuesday morning, as part of a probe into alleged offences including political interference, unlawful data extraction and sexualised deepfakes of women and children. Vedika Bahl goes through what we know so far, in this edition of Truth or Fake.

Writing on X, Musk said the raid was a "political attack".

The company said in a statement that it was "disappointed" but "not surprised," and accused the Paris Public Prosecutor's office of an "abusive act."

X also denied any wrongdoing and said the raid "endangers free speech."

The investigation began in January 2025 when French prosecutors started looking into content recommended by X's algorithm, before being widened in July that year to include Musk's controversial AI chatbot, Grok.

Yaccarino also took to X to accuse French prosecutors of carrying out "a political vendetta against Americans."

"To be clear: they are lying," added Yaccarino, who left the firm last year.

[...]

Pavel Durov - founder of the messaging app Telegram - criticised the French authorities on Tuesday, accusing France of being "the only country in the world that is criminally persecuting all social networks that give people some degree of freedom".

"Don't be mistaken: this is not a free country," he added in a post on X.

On paper, Elon Musk’s xAI is gearing up for a big year. After being folded into Musk’s SpaceX, the Grok maker could now be involved in one of the biggest — if not the biggest — IPO in history later this year.

Despite plenty of optimism and an enormous wealth of unlocked funding, a striking number of the company’s cofounders are now jumping ship. As CNBC reports, the company lost two of its cofounders in just two days, only the latest in a growing list of executives looking for greener pastures.

“Grateful to have helped cofound at the start,” AI researcher Jimmy Ba tweeted. “And enormous thanks to Elon Musk for bringing us together on this incredible journey.”

The EU has opened its own investigation into the Grok chatbot generating child sexual abuse material. It’s estimated that Grok generated 23,000 CSAM images in just 11 days. Update: A second investigation has been opened in Ireland, focusing on possible privacy violations.

Despite multiple calls for Apple and Google to temporarily remove both X and Grok from the App Store, neither company has yet done so …