Latest

Regulation & CBDC

EU investigates X over the spread of sexualized images generated with Grok

The European Commission is investigating Elon Musk's X over the spread of sexualized images generated with Grok

EU investigates X over the spread of sexualized images generated with Grok
EU investigates X over the spread of sexualized images generated with Grok

The European Commission has opened a new investigation into X, the platform owned by Elon Musk, under the Digital Services Act (DSA). It all stems from sexualized images generated or spread with the help of Grok. The European Commission is acting because manipulated sexual images (deepfakes) have begun circulating on X, many of them of women and potentially of minors, and it considers that X did not do enough to prevent this before launching Grok.

Grok facilitates the spread

For the EU, the problem is not only that these images exist, but that Grok allows them to be generated and facilitates their spread. In addition, X did not properly assess the risks before activating it in Europe and its algorithms can amplify them, reaching more people.

In this regard, Europe's action focuses on whether the company has adequately assessed and mitigated the risks associated with the deployment of Grok's functionalities in the European Union. At the same time, the Commission has expanded an ongoing investigation, opened in December 2023, into X's compliance with risk management in its recommendation systems.

ChatGPT is like Jose from ING, Grok like Red Bull on a rocket

The new investigation will examine the risks related to the spread of illegal content in the EU, such as manipulated sexually explicit images, including those that could constitute child sexual abuse material. According to the Commission, these risks appear to have materialized, exposing EU citizens to serious harm.

DSA obligations

Specifically, the Commission will investigate whether X complies with its obligations under the DSA in the following areas. Diligently assessing and mitigating systemic risks, including the spread of illegal content, the negative effects related to gender-based violence and the serious negative consequences for physical and mental well-being arising from the deployment of Grok's functionalities on its platform. Carrying out and transmitting to the Commission an ad hoc risk assessment report for Grok's functionalities on the X service.

In addition, the expansion of the December 2023 investigation will determine whether X has adequately assessed and mitigated all systemic risks associated with its recommendation systems, including the impact of its recently announced shift to a Grok-based system.

If these breaches are confirmed, they would constitute infringements of Articles 34 (paragraphs 1 and 2), 35 (paragraph 1) and 42 (paragraph 2) of the Digital Services Act. The Commission will carry out an in-depth investigation as a priority.

Gathering evidence

To prepare this investigation, the Commission has worked closely with Coimisiún na Meán, the Irish digital services coordinator, which will be associated with it in accordance with Article 66(3) of the DSA, as the national coordinator in the country where X is established in the EU.

The Commission states that it will continue gathering evidence through additional requests for information, interviews or inspections, and could impose interim measures if no significant adjustments are made to the X service. Opening the proceedings empowers the Commission to adopt enforcement measures, such as non-compliance decisions, or to accept commitments from X to remedy the issues. It also relieves national digital services coordinators of their powers to supervise these alleged infringements.

A violent and unacceptable form of degradation

Henna Virkkunen, Executive Vice-President for Tech Sovereignty, Security and Democracy, said that sexual deepfakes of women and children are a violent and unacceptable form of degradation. "With this investigation, we will determine whether X has complied with its legal obligations under the Digital Services Act, or whether it treated the rights of European citizens, including those of women and children, as collateral damage of its service."

So far, Elon Musk has not made direct statements about the new investigation opened by the European Commission against X. However, in recent months he has made comments related to content moderation and the use of Grok. Today itself, he posted an image in a humorous tone with the comment it is so hard to get moderation right, in an apparent allusion to the difficulties of controlling the generation of explicit content.

Catalina Elidafamo

Author

Catalina Elidafamo

Journalist dedicated to covering the impact of innovation on markets and society, exploring everything from the potential of tokenization to the ethical dilemmas of AI.

The latest
From Huang to Botín, from Zara to Byron: corporate responsibility in global capitalism

Keep reading