Elon Musk's social media site X has come under fire from Ofcom following complaints its AI tool Grok was able to produce images of "minors in minimal clothing".
In a statement, Britain's media regulator said it had "serious concerns" that Grok was producing "undressed images" of people.
The AI chatbot said last week it had "identified lapses in safeguards" and was "urgently fixing them".
An Ofcom spokesman said: "We are aware of serious concerns raised about a feature on Grok on X that produces undressed images of people and sexualised images of children.
"We have made urgent contact with X and xAI to understand what steps they have taken to comply with their legal duties to protect users in the UK.
"Based on their response we will undertake a swift assessment to determine whether there are potential compliance issues that warrant investigation."
Creating or sharing non-consensual intimate images or child sexual abuse material, including sexual deepfakes created by artificial intelligence, is illegal in Britain.
In addition, tech platforms have a duty to take steps to stop British users encountering illegal content and take it down when they become aware of it.
Elon Musk said anyone using Grok to make illegal content would 'suffer the same consequences' as if they uploaded it themselves
|REUTERS
Amid concerns over X, Labour frontbencher Baroness Anderson argued it was "still an appropriate platform to use", because "I believe in freedom of speech and freedom of expression".
Speaking in Parliament, Lady Anderson said government-paid advertising on the social media site had been suspended since April 2023 and it was only used for posting content free of charge.
But pressing the front bench, Liberal Democrat peer Lord Pack said: “I am sure that the minister has seen the recent reports of X generating on-request sexualised images of people without their consent, including of children, yet the Government repeatedly prioritise the use of X.
“To give just one example, the Home Office’s public social media policy encourages the use of X by promising to read all messages sent to it via that platform, a promise that is not made about any other social media network.
LATEST DEVELOPMENTS
Grok said last week that lapses in safeguards had resulted in 'images depicting minors in minimal clothing' on X
|GETTY
"Is it not the time for the Government to stop prioritising and promoting the use of X ahead of other social media network platforms?”
Lady Anderson said: “I genuinely do not agree that we prioritise the use of X, but 19.2 million British citizens use X.
"It is incredibly important, in an age of misinformation and disinformation, that facts are available on the platforms people are using, as opposed to the platforms we wish people were using, which is why the Government will continue to post organic content on X."
Grok said last week that lapses in safeguards had resulted in "images depicting minors in minimal clothing" on X and that improvements were being made to prevent this.
Screenshots shared by users on X showed Grok's public media tab filled with images that users said had been altered when they uploaded photos and prompted the bot to alter them.
"There are isolated cases where users prompted for and received AI images depicting minors in minimal clothing," the AI chatbot said in a post on X.
"xAI has safeguards, but improvements are ongoing to block such requests entirely."
"As noted, we've identified lapses in safeguards and are urgently fixing them—CSAM is illegal and prohibited," Grok said, referring to Child Sexual Abuse Material.
Mr Musk added that anyone using Grok to make illegal content would "suffer the same consequences" as if they uploaded the content themselves.