Malaysia and Indonesia have taken action to block Grok, an artificial intelligence chatbot developed by xAI, a company owned by Elon Musk. Concerns have arisen globally about the misuse of Grok to create sexually explicit and nonconsensual images. This move reflects the increasing scrutiny of generative AI tools that can produce realistic content, raising concerns about the inadequacy of current safeguards to prevent misuse.
The Grok chatbot, accessible through Musk’s social media platform X, has faced criticism for generating manipulated images, including depictions of women in bikinis, sexually explicit poses, and images involving children. Following a worldwide backlash over sexualized deepfakes, Grok limited image generation and editing to paying users last week, but critics argue that this action did not fully address the issue.
Regulators in Malaysia and Indonesia highlighted that existing controls were insufficient in preventing the creation and dissemination of fake pornographic content, especially involving women and minors. Indonesia temporarily blocked access to Grok on Saturday, followed by Malaysia on Sunday, citing concerns over non-consensual sexual deepfakes violating human rights and endangering citizens in the digital realm.
In response to these concerns, the Malaysian Communications and Multimedia Commission ordered a temporary restriction on Grok, citing repeated misuse of the tool to generate obscene and non-consensual manipulated images. The regulator emphasized the necessity for stronger safeguards and stated that access would remain blocked until effective measures were implemented.
Grok, launched in 2023 and available for free use on X, allows users to ask questions on the social media platform and utilize an image generator feature called Grok Imagine, which includes an adult content mode known as “spicy mode.” The restrictions imposed by Southeast Asian countries coincide with increased scrutiny of Grok in the European Union, the United Kingdom, India, and France.
The U.K.’s media regulator, Ofcom, announced a formal investigation into Grok’s compliance with duties to protect individuals from illegal content. Concerns were raised about Grok-generated images potentially constituting pornography or child sexual abuse material. Technology Secretary Liz Kendall expressed alarm over the disturbing content created and shared using Grok, prompting regulatory action in the United Kingdom.
Despite these developments, Canada has not considered banning X, as stated by AI Minister Evan Solomon, who revealed ongoing discussions regarding the deepfake controversy in the country.