Deepfakes Explained: How to Recognize, Prevent, and Respond to AI-Manipulated Content

Deepfakes are video, image, or audio files manipulated with the help of artificial intelligence. To create them, perpetrators use original photos taken from private collections, freely accessible websites, or social media accounts. When such manipulated material is created and spread without consent, it becomes a serious problem. Deliberately harmful deepfakes are a form of digital violence. If the content is sexualized, it is referred to as a 'sexualized deepfake' or 'deep nude'.

In principle, anyone whose digital images, videos, or audio recordings exist online can be affected. AI-generated forgeries are misused in several ways. Fake calls use AI-generated voices to deceive people and extract money. False reports present politicians or public figures in invented videos, damaging their reputation and undermining trust in genuine news. Financial abuse occurs when criminals use deepfakes to access accounts or financial platforms, or to order goods under a false identity. Sexualized violence is a particular concern: women are frequently targeted, with manipulated material uploaded to pornographic platforms alongside degrading comments and personal data, which can lead to blackmail and reputational harm. Children are also affected, although the true extent often remains hidden. Digital harassment and bullying use deepfakes to humiliate, defame, or push people out of public discussion.

Deepfakes intrude deeply into privacy and can cause severe psychological strain, including stress, anxiety, and suicidal thoughts, as well as physical health consequences. Victims often experience a threat to their personal integrity, confusion, self-doubt, and feelings of shame or guilt. Fear of social exclusion and of consequences in personal, professional, or financial life is common, as is a sense of powerlessness. Victims may also face victim blaming, which shifts responsibility from perpetrator to victim. Many withdraw from online and offline contacts. Image-based sexualized violence can be experienced as a physical sexual assault.

First, collect evidence. As long as the material does not show nude images of minors, a legally sound screenshot can be made. Only after securing evidence should you report the content to the platform or operator. You can also report the material to an internet complaints office. Note that after reporting, you may no longer be able to access the reported post. If you have fallen victim to telephone or financial fraud, the next step is to file a police report, for example through the Online-Wache of Polizei Sachsen. For guidance on securing evidence, see the resources on creating legally sound screenshots. Special handling applies if intimate images of children or adolescents are involved.

Protect your children's privacy, for example by encouraging private accounts. Inform and raise awareness among children and young people about the risks. Discuss the meaning of consent versus boundary violations in an age-appropriate way. Create an open atmosphere in which children feel encouraged to speak about incidents and, where necessary, report them. Use platform features to report content so that further spread can be prevented.

To file a criminal complaint, use the Online-Wache of Polizei Sachsen. Content can be reported to the Internet-Beschwerdestelle. If you are affected by sexualized deepfakes, specialized professionals are recommended, such as the Hilfeportal Sexueller Missbrauch. WEISSER RING provides victim and crisis support as well as legal advice, with free and anonymous help by phone at 116 006 and online counseling. HateAid is a specialized contact point for digital violence, reachable at +49 (0)30 25208838 or beratung@hateaid.org. Children and young people can turn to JUUUPORT, a nationwide online counseling platform for young people facing problems online. Those who want to help affected persons can also find advice at these services.

For further information, consult guidance on how to create legally sound screenshots. Be aware that intimate image content involving children or adolescents must be handled separately and with particular care. Staying informed and seeking qualified support early can significantly reduce the harm caused by deepfakes and help protect yourself and others in the digital space.