A 2017 neologism for deep-learning-generated synthetic media, and one of the most acute current concerns in image-based sexual abuse. The technology and the harm appeared together: the original 2017 Reddit usage of deepfake was for the non-consensual sexual content the unnamed user was producing. The decade since has consolidated both the technical capability and the harm, and the present regulatory landscape is structured around both.

Overview

Deepfake is the compound of deep learning and fake, and refers to synthetic media — image, audio, or video — generated by machine-learning techniques to impersonate a real person or to alter existing media. The term originated in December 2017 as the username of an anonymous Reddit user who posted face-swap content placing actresses’ faces onto adult video footage. The term has since become the standard reference for the wider class of techniques, with the connection to non-consensual sexual content remaining a definitional and structural feature.

The technical substrate includes generative adversarial networks (GANs, after Ian Goodfellow et al. 2014), variational autoencoders, and (from the early 2020s) diffusion models such as Stable Diffusion. Voice cloning extends the same approach to audio. The general direction of technical development has been toward higher fidelity, more accessible tooling, and shorter source-material requirements.

The harm structure is well-established. Studies by Deeptrace Labs (2019) and Home Security Heroes (2023) have consistently found that 95–98% of identified deepfake videos online are sexual content, and that 99% of the depicted persons are women. The principal categories of harm: celebrity-targeted non-consensual sexual content, ex-partner targeting (an extension of revenge porn), general-population targeting (often students), and political disinformation. The harm structure aligns deepfakes with the wider category of image-based sexual abuse / non-consensual intimate imagery, and the legal frameworks treat them as part of that category.

Origins and historical development

2017–2018: emergence

In December 2017, a Reddit user named deepfakes opened the r/deepfakes subreddit and posted face-swap content placing actresses including Gal Gadot, Emma Watson, and Scarlett Johansson onto adult video footage. The technique used auto-encoder architectures to learn the face mapping and substitute one face for another in existing video. The subreddit operated for some weeks before being banned in February 2018 under Reddit’s non-consensual pornography policy.

In January 2018, the GUI tool FakeApp made the technique accessible to non-specialist users. Major platforms — Reddit, Twitter, Pornhub — announced bans on non-consensual deepfake content in early 2018, but specialist sites continued to operate and to grow. The 2018–2019 period established the technique as a substantial source of non-consensual sexual content of real women.

2019–2022: quantitative expansion

The 2019 Deeptrace Labs report documented approximately 14,678 deepfake videos online, of which 96% were non-consensual sexual content; almost all targeted women. The 2020 DeepNude / Telegram-bot variants generated synthetic nude imagery from clothed photographs and reached very large user bases before being shut down. The European and Southeast Asian deployments of these tools confirmed a wide international distribution of the harm.

2022–present: diffusion models

The 2022 public release of Stable Diffusion and the parallel deployment of DALL-E, Midjourney, and related diffusion-model systems made text-to-image generation widely accessible. Fine-tuning techniques (LoRA, DreamBooth) enabled targeted generation of specific real persons from limited source material. The 2024 case involving non-consensual deepfake images of Taylor Swift, distributed at scale on X (Twitter) before platform takedown, marked the public-attention turning point for the diffusion-model wave and accelerated legislative responses.

The South Korean cases of 2024 — large-scale deployment of generated sexual imagery against female students using Telegram and school directories as targeting infrastructure — drove particularly aggressive legislative response in that jurisdiction.

Legal frameworks

United States

The US federal response was the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes On Websites and Networks Act (TAKE IT DOWN Act), enacted as Public Law 119-12 after S.146 passed both chambers (House 409-2, Senate by unanimous consent) and was signed on 19 May 2025 by President Trump. The Act creates a federal criminal offence for the knowing publication of an intimate visual depiction or a digital forgery (i.e. AI-generated deepfake) of an identifiable individual, with penalties up to two years’ imprisonment for adult depictions and three years for depictions of minors. The Act imposes a notice-and-removal regime on covered platforms with a 48-hour response window, under Federal Trade Commission enforcement, with platform-side compliance due by 19 May 2026.

State-level legislation preceded the federal act. The 2019 Virginia legislation was the first state-level deepfake criminal offence; California, Texas, New York, and others followed, with more than twenty states having some form of regulation by 2024. The state legislation varies in scope, with some states requiring intent to harm and others reaching reckless or knowing disclosure.

The DEFIANCE Act (Disrupt Explicit Forged Images and Non-Consensual Edits Act), proposed in 2024, would have created a federal civil cause of action; the TAKE IT DOWN Act 2025 supersedes its principal provisions in providing a federal criminal remedy.

United Kingdom

The UK Online Safety Act 2023 introduced offences for the sharing of altered intimate images and the threat to share such images. Subsequent legislation has extended to the creation of deepfake intimate images regardless of distribution. The UK position aligns with revenge porn regulation under the Criminal Justice and Courts Act 2015 Section 33 and the Domestic Abuse Act 2021.

European Union

The AI Act (Regulation 2024/1689, adopted 13 March 2024, in force from 1 August 2024) Article 50 establishes a deepfake-transparency obligation: AI-generated content must be marked as such. The AI Act is a horizontal AI-regulation framework rather than a deepfake-specific statute, and member states retain criminal-law jurisdiction. Germany’s Strafgesetzbuch §201a, France’s Loi SREN (2024), and other member-state criminal frameworks provide deepfake-specific criminal offences. The Digital Services Act (Regulation 2022/2065) imposes notice-and-action obligations on large online platforms.

South Korea

South Korea responded to the 2024 cases with particularly aggressive legislation. The amended Sexual Violence Punishment Act extended criminal liability to the possession and viewing of deepfake sexual content (not only creation and distribution), with maximum penalties of seven years’ imprisonment. The South Korean framework is one of the more punitive globally.

Japan

Japan does not have a deepfake-specific statute. Existing laws provide partial coverage: criminal defamation and insult (Penal Code Articles 230 and 231); the obscenity-distribution offence (Article 175); the Child Pornography Act (where the depicted figure is a minor); the Revenge Porn Act (which requires the depiction of the subject’s own physical form and therefore covers deepfakes only with interpretive difficulty). Government bodies — the Ministry of Internal Affairs and Communications, the Ministry of Justice — have run review committees since 2023 on the question of dedicated legislation.

Survivor support

Takedown and hash-matching

Major platforms operate notice-and-takedown procedures for non-consensual intimate imagery, including deepfake content. The StopNCII.org hash-matching service (operated by the UK Revenge Porn Helpline) allows survivors to register intimate images and have them automatically blocked from upload across participating platforms including Meta, TikTok, and Bumble. The hash-matching architecture is effective for limiting cascade redistribution after initial publication, though limited against re-generated images that produce different hashes.

Psychological impact

The clinical literature on survivors of deepfake non-consensual sexual content documents psychological consequences comparable to other forms of image-based sexual abuse: post-traumatic stress, anxiety, depression, suicidal ideation. Survivor-support organisations — the Revenge Porn Helpline in the UK, the Cyber Civil Rights Initiative in the US, the StopNCII partnership network — provide specialised support.

Technical and ethical debates

Detection limitations

Detection of synthetic media operates as an arms race against generation. Detection methods rely on the identification of artifacts characteristic of generation models (lighting inconsistencies, biological signal absences, model-specific frequency-domain features). Microsoft’s Video Authenticator (2020) and Intel’s FakeCatcher (2022) are public detection systems. Generation techniques evolve, and detection lags behind generation in capability. Detection-only approaches are not a sustainable response.

Provenance approaches

The Coalition for Content Provenance and Authenticity (C2PA), launched 2021 by Adobe, Microsoft, BBC, and others, develops cryptographic provenance standards for media. Provenance recording from capture device through editing chain provides a positive authentication path, in contrast to the negative detection path; provenance is the principal current direction of industry response.

Platform responsibility

The wider question of platform responsibility — for the generation tools (Stable Diffusion, Midjourney, others), for the training data, for the distribution platforms — is a continuing regulatory and ethical debate. The relationship between the generation-tool providers and the harm produced through downstream use is contested in legal commentary and policy work.

Cultural reception

The 2024 high-profile cases — the Taylor Swift X distribution, the South Korean student-targeting cases — have driven sustained mainstream media attention to deepfake sexual content. The public framing of the issue has shifted from a technical curiosity to a recognised form of gender-based harm, in alignment with the framing in academic and survivor-advocacy work. The integration of deepfake harm into the wider image-based sexual abuse framework is now the standard analytical position.

See also

• Revenge porn / Image-based sexual abuse
• Waisetsu
• Onlyfans