Logo for AiToolGo

Deepfake Pornography and German Criminal Law: Protection Gaps, Legal Frameworks and the Fight Against Non-Consensual Sexualized Deepfakes

In-depth discussion
Academic
 0
 0
 5
This bpb (Federal Agency for Civic Education, Germany) article by Jacqueline Sittig examines nonconsensual sexualized deepfakes, particularly deepfake pornography, as a form of image-based sexualized violence. It analyzes how deepfakes disproportionately affect women and marginalized groups, distinguishes harmless from harmful uses, and reviews the German criminal law framework (StGB provisions such as §§ 131, 184, 184a, 201a, 185 ff., 177, 253, 46 Abs. 2) and its gaps. It also covers EU regulation (DSA, AI Act, the directive on violence against women) and a planned new offense (§ 201b StGB). The article concludes that protection remains incomplete but that new legislation and growing awareness offer hope.
  • main points
  • unique insights
  • practical applications
  • key topics
  • key insights
  • learning outcomes
  • • main points

    • 1
      Clear conceptual framing of deepfake pornography within the broader context of image-based sexualized violence, grounded in established scholarly terminology
    • 2
      Systematic legal analysis mapping specific German criminal provisions to different forms of nonconsensual sexualized deepfakes
    • 3
      Intersectional perspective highlighting gendered and marginalized-group impacts supported by cited empirical data
  • • unique insights

    • 1
      Explains that the same deepfake can violate rights of both the person whose face is used and the person in the original source material, showing the multi-party rights dimension
    • 2
      Identifies the gendered aggravating factor under § 46 Abs. 2 StGB and the 'silencing effect' on democratic discourse as a societal harm
  • • practical applications

    • Provides a legal orientation for understanding which German and EU provisions may apply to deepfake abuse, useful for educators, policymakers, and potential victims seeking awareness of protections and support resources such as HateAid, as well as AI-detection options.
  • • key topics

    • 1
      Definition and scope of nonconsensual sexualized deepfakes and deepfake pornography
    • 2
      Gendered dimension and intersectional impact on women and marginalized groups
    • 3
      German criminal law framework and its gaps, plus EU regulation (DSA, AI Act, violence-against-women directive)
  • • key insights

    • 1
      Connects technical deepfake developments with concrete German criminal provisions in a single accessible overview
    • 2
      Frames deepfake abuse as part of digital gender-based violence rather than an isolated technological issue
    • 3
      Offers a balanced distinction between harmless and harmful deepfake uses, including consent-based content
  • • learning outcomes

    • 1
      Understand the definition and scope of nonconsensual sexualized deepfakes within image-based sexualized violence
    • 2
      Identify which German criminal law provisions may apply to different forms of deepfake abuse and where legal gaps remain
    • 3
      Recognize the gendered and intersectional dimensions of deepfake harm and the relevance of EU regulation such as the DSA and AI Act
examples
tutorials
code samples
visuals
fundamentals
advanced content
practical tips
best practices

“ Introduction: Deepfakes and Victim Blaming

Non-consensual sexualized deepfakes are far from isolated incidents. When victims of intimate image abuse come forward, they are too often met with blame, with the suggestion that they should simply not have shared such images in the first place. Researchers such as Nivedita Prasad describe a troubling revival of victim blaming in digital gender-based violence. Such reasoning ignores a fundamental shift: digitalization has created new forms of punishable harm. Audiovisual content online no longer necessarily depicts real events, because artificial intelligence can now manipulate images, audio and video with unprecedented realism. This makes it all the more important to understand how criminal law protects people against these practices, and where its gaps lie.

“ Understanding Deepfake Pornography and Image-Based Sexual Violence

Deepfake pornography must be understood within the broader context of image-based sexual violence. Scholars Clare McGlynn and Erika Rackley shaped this framework, and in the German-speaking context the term refers to creating, distributing and using intimate or sexually connotated images of a person without their consent. Such material typically shows nudity or underwear-clad genitals, breasts, or intimate poses and activities, and is usually framed in a sexualized, defamatory manner. AI tools now allow manipulation of existing material with a quality that is often impossible to detect with the naked eye, producing convincingly realistic pornographic content.

“ Who Is Affected: Deepfakes and Gender-Specific Harm

Deepfakes affect everyone, but not equally. The growing supply of easy-to-use deepfake apps allows people without technical expertise to create them. Anyone whose images or videos are publicly available online, for example on social networks, can be targeted. Perpetrators also draw on privately shared content obtained with consent, as well as material accessed without authorization. Analyses show that pornographic deepfakes vastly outnumber non-pornographic ones; a 2020 report by Sensity attributed up to 93% of deepfake content to pornography. An intersectional perspective reveals that women and marginalized groups are particularly affected. A 2019 analysis by Deeptrace found that all pornographic deepfake videos depicted women, while non-pornographic videos were more evenly split. Public figures, including politicians, scientists, activists and entertainment industry women, are especially at risk. The consequences are severe at both societal and individual levels: on a societal level, the silencing effect pushes diverse voices out of online spaces and threatens democratic discourse; on an individual level, it can cause lasting psychological and physical harm through degrading sexualized objectification.

“ Distribution Channels and the Role of Misogynistic Communities

Deepfake pornography spreads through many channels. Beyond private communication via WhatsApp, email and SMS, it circulates on non-pornographic platforms such as social networks and dating sites, on mainstream pornography websites, and on dedicated revenge-pornography platforms. Its spread is fuelled by misogynistic groups, such as the Incel movement, which seek to spread hostility toward women online. Researchers Jenny-Kerstin Bauer and Ans Hartmann describe this as a deliberately chosen, woman-hostile and violent milieu. Because of the intimate and largely uncontrollable nature of this content, victims face a heightened risk of repeated, prolonged or even permanent victimization.

“ Harmless Versus Harmful Deepfakes: Where the Line Is Drawn

Legal assessment requires distinguishing harmless deepfakes from deliberately harmful ones. The boundary is often blurred. Popular face-swapping tools, for instance, can be used for humor or artistic purposes, yet they are also widely misused to place the faces of actresses onto pornographic performers. The rights at stake are not only those of the person whose original material is used, but also those of the person whose face is inserted into a new, sexualized context. Harmless uses typically rely on the consent of the depicted persons. Consent-based science-fiction pornography, for example, is a recognized category on some platforms. Without consent, however, creating and using deepfake pornography can infringe copyright under § 106 UrhG in conjunction with § 108 UrhG, or the right to one's own image under Art. 2(1) and Art. 1(1) GG and §§ 22 f. KUG in conjunction with § 33 KUG. Satirical or humorous deepfakes, such as memes, require case-by-case balancing between the expressing party's freedom of expression and the affected person's personality rights. Because deepfake pornography intrudes on intimacy, it usually violates the right to sexual self-determination under Art. 2(1) GG, which can outweigh freedom of expression.

“ Legal Limits on Non-Consensual Sexualized Deepfakes in Germany

The core of harmful deepfake pornography is that its content is created, distributed or otherwise used without the consent of the depicted persons. Such conduct can violate the right to sexual self-determination and general personality rights. German criminal protection stems primarily from the Strafgesetzbuch (StGB), a code written for the analog world. As a result, protection is spread across numerous provisions, many of them shaped by individual cases, and which applicable offence applies depends on the specific circumstances. Where deepfakes contain depictions of violence, § 131(1) Nos. 1 and 2 StGB may apply, as may § 184a StGB concerning violent pornographic content. It remains unsettled whether these provisions cover AI-manipulated, fictional depictions or only real ones. The distribution of sexualized deepfakes, though not necessarily their creation, may fall under § 201a(1) Nos. 1 and 4 and (2) StGB, which protects the highly personal sphere and image rights. Distribution may also constitute the dissemination of pornographic content under § 184 StGB. Creation and distribution may further trigger the insult offences in §§ 185 ff. StGB. It is still unclear whether § 184k StGB, on violations of intimate privacy through image recordings, applies to deepfake pornography.

“ Accompanying Offences and Gender-Specific Aggravation

Deepfake pornography is frequently accompanied by other criminal acts. Insulting comments may be punishable, as may hacking to obtain material, which falls under § 202a(1) StGB on data espionage. Sextortion can constitute sexual coercion under § 177 StGB or extortion under § 253 StGB, while doxing, the endangering dissemination of personal data, may be punishable under § 126a StGB. A gender-specific perspective adds another dimension. Under § 46(2) StGB, a gender-specific motive can serve as an aggravating factor in sentencing. Offences directed against women because of their gender can therefore be penalized more severely within the statutory range.

“ The Proposed § 201b StGB and Upcoming Legislation

In July 2024, the Bundesrat responded to serious gaps in protection and the growing dangers posed by deepfakes by passing a draft law on the criminal protection of personality rights. The proposal would create a new offence, 'Violation of personality rights through digital forgery' under § 201b StGB. A further planned law against digital violence aims to help victims enforce their rights in court. Together, these measures signal an effort to close the fragmentation of current law and make protection against digital forgeries more coherent.

“ International and EU Regulation

Beyond national law, international and EU rules play an important role. EU law takes precedence over national law in Member States. A key challenge is holding platform operators and developers of AI systems accountable, since the anonymity of many users who spread such content makes removal and prosecution difficult. The Digital Services Act (DSA), in force since November 2022 and implemented in Germany through the Digitale-Dienste-Gesetz (DDG), imposes obligations on large online platforms and search engines, including a notice procedure to facilitate the removal of illegal content and protect users. The AI Act, in force since August 2024, follows a risk-based approach. However, deepfake software is classified only as an AI system with limited risk, meaning comparatively modest transparency obligations apply. In addition, Article 7 of the Directive on combating violence against women and domestic violence, in force since June 2024, covers the non-consensual production and sharing of intimate or manipulated material, reflecting the particular exposure of women and marginalized groups to digital violence.

“ Conclusion and Ways Forward for Victims and Society

The incomplete protection against the creation of non-consensual sexualized deepfakes and other forms of image-based sexual violence against adults leaves significant gaps that burden victims. Given the particular exposure of women and marginalized groups, combating these practices is essential to preserving diversity on the internet. At the same time, recently enacted and forthcoming national and international laws, together with growing social awareness, offer grounds for hope. Those who wonder whether they appear in deepfake pornography can use AI detection tools to check. Victims are not left alone: beyond legal counselling, support organizations such as HateAid are available to help them.

 Original link: https://www.bpb.de/lernen/bewegtbild-und-politische-bildung/556843/strafrecht-und-regulierung-von-deepfake-pornografie/

Comment(0)

user's avatar

      Related Tools