Grok blocked from undressing images in places where it’s illegal
By ELAINE KURTENBACH, Associated Press Business Writer
BANGKOK (AP) — Elon Musk’s AI chatbot Grok will no longer be able to manipulate photos to depict real individuals in revealing attire in regions where it is prohibited, as stated on X.
Following a global outcry over sexualized images of women and children, which resulted in bans and warnings from various governments, the announcement was made late Wednesday.
California, the most populous state in the U.S., revealed an investigation on Wednesday into the spread of nonconsensual sexually explicit content created using Grok, targeting women and girls.
Initially, inquiries regarding the issue were met with the response, “legacy media lies.”
xAI, Musk’s company, has now stated that it will block content geographically if it violates local laws.
“We have put in place technological measures to prevent the editing of images of real people in revealing attire like bikinis, underwear, and other revealing clothing on the Grok platform,” the statement read.
This rule applies to all users, including those with paid subscriptions who have access to additional features.
xAI has also restricted image creation and editing to paid subscribers only “to ensure accountability for individuals attempting to misuse the Grok platform to break the law or violate our policies.”
Grok’s controversial “spicy mode” had enabled users to generate explicit content, prompting backlash from governments worldwide.
Countries like Malaysia and Indonesia took legal action and blocked access to Grok, while authorities in the Philippines announced plans to do the same, potentially within the week. Investigations into potential violations of online safety laws were initiated by the U.K. and European Union.
France and India issued warnings, calling for stricter controls. Brazil called for an inquiry into the misuse of Grok.
The British government, a vocal critic of Grok in recent days, welcomed the changes, while the country’s regulator, Ofcom, stated that it would continue its investigation.
“I will not stop until all social media platforms fulfill their legal obligations and provide a safe and age-appropriate service to all users,” said Technology Secretary Liz Kendall.
California Attorney General Rob Bonta urged xAI to prevent further harassment of women and girls through Grok’s editing functions.
“We have a zero-tolerance policy for AI-generated creation and distribution of nonconsensual intimate images or child sexual abuse material,” he declared.
California has enacted laws to protect minors from AI-generated sexual imagery of children and mandate that AI chatbot platforms remind users they are not interacting with a human.
However, Democratic Gov. Gavin Newsom vetoed a bill last year that would have limited children’s access to AI chatbots.
Pan Pylas in London contributed to this report.
