Technology & AI
Should AI-Generated Political Deepfakes Be Criminalised?
LNAT Section B ยท Model essay
The essay prompt
Should it be a crime to create or spread AI-generated deepfake videos and audio of politicians during election campaigns? Set out the arguments on each side and reach a reasoned conclusion.
The stance
Yes, but only through a narrowly tailored offence. A political deepfake counterfeits a person's identity and audiovisual 'evidence', so when it is deployed to deceive voters about a candidate or the voting process it strikes at electoral integrity in a way ordinary spin does not. Counterspeech and civil law cannot outrun a clip that travels in hours. The defensible position is therefore criminalisation that is intent-based, confined to the regulated campaign period, and carved out for satire, journalism and art; a blanket ban on the technology itself would be a different and indefensible thing.
Defining the terms
- Political deepfake: synthetic audio or video, generated by AI, that depicts a candidate or official saying or doing something they never said or did, and is deployed in an election context.
- Criminalisation (as argued here): a narrow criminal offence requiring an intent (or recklessness) to mislead voters about a candidate or the voting process, not a ban on making synthetic media as such.
- Campaign period: the regulated weeks before polling, when electoral integrity is most exposed and counterspeech has least time to work.
- Carve-outs: clearly labelled parody, satire, art and investigative journalism, which the offence must protect rather than capture.
- Liar's dividend: the secondary harm whereby, once deepfakes are common, genuine recordings can be dismissed as fakes, eroding the value of all audiovisual evidence.
Assumptions to interrogate
- That fact-checking and counterspeech are fast enough to neutralise a viral clip inside a high-velocity digital market.
- That existing fraud, defamation and electoral-impersonation laws already capture the specific harm of a political deepfake.
- That criminalising deepfakes must inevitably chill legitimate political satire and comment.
- That a deepfake is just a vivid version of an ordinary political lie, and so needs no distinct treatment.
- That a criminal sanction can be drafted and enforced quickly enough to bite before an election it is meant to protect.
The case for
A deepfake counterfeits perception itself, so it bypasses the reasoning counterspeech relies on.
An ordinary lie still has to persuade; a fabricated video of a candidate hijacks the viewer's senses before any argument begins. The 2024 New Hampshire robocall, which cloned President Biden's voice to tell Democrats not to vote in the primary, shows the mechanism: it did not argue, it impersonated. When fabrication operates below the level of deliberation, the marketplace-of-ideas defence, that more speech cures bad speech, runs out of time.
The harm is to electoral integrity, a public good, not merely to one candidate's reputation.
Defamation protects an individual; a deepfake released days before a poll injures the electorate's capacity to choose. Canada's own electoral reform recognised this: Bill C-65 (2024) extended the impersonation and misleading-publication offences in the Canada Elections Act so they apply regardless of the medium, expressly to catch deepfakes that make candidates appear to say things they never did. The state's interest is in the integrity of the vote, which is exactly what a narrow offence protects.
Civil remedies and platform takedowns are structurally too slow.
By the time an injunction is obtained or a clip is removed, the campaign is over. The Zelensky 'surrender' deepfake of March 2022 was removed by Meta and YouTube within hours, yet it had already spread, and only worked at all because the Ukrainian government had pre-warned the public. Most deepfakes will not be pre-empted that way. A criminal sanction supplies the deterrence that after-the-fact civil clean-up cannot.
A precise, intent-based offence is consistent with free expression, which is a qualified right.
Article 10 ECHR protects even false statements in principle, but expressly permits restrictions that are prescribed by law, pursue a legitimate aim and are necessary in a democratic society. Protecting the integrity of elections is a paradigm legitimate aim, and an offence keyed to intentional voter deception, with satire and journalism carved out, is the proportionate response rather than a blanket prohibition on the technology.
The case against
A broadly drafted offence would chill satire, parody and legitimate comment.
Political mockery, impressions and obviously synthetic comedy are core protected expression. A vague law against 'deceptive synthetic media' risks sweeping in 'deep-Trump' comedy or campaign attack ads that voters understand as caricature. In United States v Alvarez (2012) the US Supreme Court struck down a law criminalising lies about military honours, holding that falsity alone does not strip speech of protection. Over-broad criminalisation would punish the lie rather than the harm.
Existing law may already cover the genuinely harmful cases.
The Biden robocall was prosecuted without any bespoke deepfake statute: Steve Kramer faced a $6 million FCC forfeiture under the Truth in Caller ID Act and criminal charges for voter suppression and candidate impersonation. If fraud, electoral-impersonation and intimidation offences already reach the conduct, a new crime may be redundant symbolism that adds enforcement complexity without adding protection.
Criminal law is poorly matched to a fast, anonymous, cross-border harm.
Deepfakes can be generated abroad, posted anonymously and amplified by algorithms before any investigation begins. A criminal trial concludes long after the election it was meant to protect, and may catch a low-level resharer while the foreign originator stays out of reach. The mismatch between the speed of the harm and the pace of prosecution is a real objection to relying on criminalisation at all.
Labelling and disclosure may achieve the aim with a lighter touch.
The EU AI Act requires that AI-generated or manipulated audiovisual content be clearly disclosed as such, a transparency duty rather than a speech ban. If the wrong is undisclosed deception, a mandatory-labelling regime targets exactly that wrong while leaving labelled satire and comment untouched, arguably a more proportionate first response than a criminal offence.
The argument, step by step
- Reframe the question: this is not 'should we ban synthetic media', but 'should the law criminalise deepfakes deployed to deceive voters in a campaign'.
- Establish the distinction: a political deepfake counterfeits identity and audiovisual evidence, so it bypasses reasoning rather than competing in argument, unlike an ordinary lie.
- Identify the protected interest: the harm falls on electoral integrity, a public good, which existing reputational and individual remedies do not capture.
- Show why softer tools fail in isolation: counterspeech and civil takedowns are too slow against virality, as the Zelensky clip and the Biden robocall illustrate.
- Meet the rights objection head-on: Article 10 and Alvarez require any offence to be narrow and harm-based, so it must be intent-keyed, campaign-limited and carved out for satire and journalism.
- Resolve toward a tailored offence, backed by disclosure duties: criminalise intentional voter-deceiving deepfakes, layer the EU-style labelling regime beneath it, and reject any blanket ban on the technology.
The model plan
Stance: yes, criminalise political deepfakes, but only via a narrow, intent-based, campaign-limited offence with satire/journalism carve-outs; reject a blanket technology ban. Intro (approx 80 words): reframe from 'ban synthetic media' to 'criminalise voter-deceiving deepfakes in a campaign'; flag the identity-counterfeit distinction and the Article 10 hook. P1 (why a deepfake is categorically different): it counterfeits perception and bypasses reasoning; 2024 Biden robocall as the mechanism; counterspeech runs out of time. P2 (the protected interest is electoral integrity): harm is to the electorate not one reputation; Canada Bill C-65 (2024) extended Elections Act impersonation/misleading-publication offences to catch deepfakes regardless of medium; civil remedies too slow, Zelensky clip removed in hours but already spread. P3 (the strongest objection, free expression): Article 10 ECHR protects even falsehoods, qualified by the necessity/proportionality test; United States v Alvarez (2012, 567 US 709) struck down criminalising lies about honours; over-broad law would chill satire. P4 (answer the objection and add the lighter-touch option): redundancy point, Biden case prosecuted under Truth in Caller ID Act + voter-suppression/impersonation charges and a $6m FCC forfeiture, so the offence must add precision not duplication; EU AI Act disclosure duty as a proportionate layer beneath the offence; cross-border/speed limits mean criminal law is necessary but not sufficient. Conclusion (approx 70 words): a narrow intent-based offence plus disclosure, not a blanket ban; the law's task is to separate liberty from licence. Each point links back to voter deception as the wrong.
The model essay
Asked as a flat question, this sounds like a referendum on a technology, but the serious version is narrower. The issue is not whether AI-generated media should be banned, but whether the law should criminalise deepfakes deployed to deceive voters during an election campaign. I will argue that it should, through a tightly drawn offence that requires an intent to mislead voters, is confined to the regulated campaign period, and carves out satire, journalism and art. A blanket ban on the technology would be a different and indefensible thing.
The case for treating these as a distinct wrong rests on what a deepfake actually does. An ordinary political lie still has to persuade; it competes in the marketplace of ideas, where more speech can answer it. A fabricated video of a candidate does not argue, it impersonates, hijacking the viewer's senses before any reasoning begins. The clearest illustration is the 2024 New Hampshire robocall, which cloned President Biden's voice to tell Democrats to stay home in the primary. It did not make a false claim to be rebutted; it counterfeited the man himself. When deception operates below the level of deliberation, the comforting answer that counterspeech will cure it simply runs out of time.
The harm, moreover, falls on a public good rather than a private reputation. Defamation protects an individual's standing; a deepfake released days before a poll injures the electorate's capacity to choose, and the 'liar's dividend' compounds the damage, because once fabrication is common, genuine recordings can be dismissed as fakes too. Canada has already recognised this institutional harm. Bill C-65, introduced in 2024, extended the impersonation and misleading-publication offences in the Canada Elections Act so that they apply regardless of the medium, expressly to capture deepfakes that make candidates appear to say what they never said, while leaving satire and parody untouched. Civil remedies cannot do this work, because they are structurally too slow: the Zelensky 'surrender' deepfake of March 2022 was removed by the platforms within hours, yet it had already spread, and worked at all only because Ukraine had pre-warned the public. Most deepfakes will not be pre-empted that way, and an injunction obtained after the count protects no one.
The strongest objection is free expression, and it must be taken seriously. Article 10 of the Convention protects even false statements in principle, and in United States v Alvarez (2012) the US Supreme Court struck down a law criminalising lies about military honours, holding that falsity alone does not forfeit protection. A clumsy offence against 'deceptive synthetic media' would indeed sweep in comedy impressions and obvious caricature, punishing the lie rather than the harm. But Article 10 is a qualified right: restrictions are permitted where they are prescribed by law, pursue a legitimate aim and are necessary in a democratic society, and protecting the integrity of elections is a paradigm legitimate aim. The answer to Alvarez is not to abandon the offence but to draft it precisely, keyed to an intent to deceive voters, limited to the campaign window, with satire and journalism expressly carved out.
Two further worries push toward modesty rather than abandonment. First, existing law may already reach the worst cases: the Biden robocall drew a six-million-dollar FCC forfeiture under the Truth in Caller ID Act and criminal charges for voter suppression and candidate impersonation, with no bespoke deepfake statute in sight. A new offence must therefore add precision, not duplication. Second, the harm is fast, anonymous and cross-border, while prosecution is slow, so criminal law is necessary but not sufficient. This is why the offence should sit above a lighter-touch layer: the EU AI Act's duty to disclose AI-generated audiovisual content targets the real wrong, undisclosed deception, while leaving labelled satire alone.
The defensible conclusion, then, is a regulated yes. Criminalise the intentional, campaign-period deepfake that is designed to deceive voters about a candidate or the vote, carve out parody, satire, art and journalism, and underpin the offence with a mandatory disclosure regime. Reject, equally firmly, any blanket prohibition on synthetic media as such. The law's task here is the old one in new dress: to separate liberty from licence, protecting the comedian and the journalist while denying the forger the power to counterfeit a democracy.
Authorities worth knowing
United States v Alvarez
567 U.S. 709 (2012), US Supreme Court, 28 June 2012
A 6-3 Supreme Court struck down the Stolen Valor Act, which criminalised falsely claiming military decorations, holding that the falsity of a statement does not on its own remove it from First Amendment protection; restrictions on false speech must be narrowly tailored to a genuine harm. Read across to deepfakes, it warns that any offence must target demonstrable harm, not falsity as such.
FCC v Steve Kramer (2024 New Hampshire Biden robocall)
FCC Forfeiture Order, $6,000,000, adopted 26 September 2024; New Hampshire criminal indictment (voter suppression and candidate impersonation), 2024
A political operative used an AI clone of President Biden's voice in spoofed robocalls urging New Hampshire Democrats not to vote in the 2024 primary. He drew a $6m FCC forfeiture under the Truth in Caller ID Act and state criminal charges, showing both that political voice deepfakes cause concrete electoral harm and that some existing offences already reach the conduct.
Bill C-65, An Act to amend the Canada Elections Act
Bill C-65, 44th Parliament (Canada), tabled 20 March 2024
The Bill amended the impersonation and misleading-publication offences in the Canada Elections Act to clarify that they apply regardless of the means, medium or manner used, expressly so as to capture AI deepfakes that impersonate candidates or election officials, while excluding material used solely for political satire or parody.
Online Safety Act 2023, s 188 (inserting s 66B into the Sexual Offences Act 2003)
Online Safety Act 2023 (c. 50), s 188; Sexual Offences Act 2003, s 66B
Section 188 inserted a new offence of sharing an intimate photograph or film without consent, drafted to cover images that 'show, or appear to show' a person in an intimate state, so as to capture manipulated and deepfake imagery. It shows the UK criminalising one category of harmful deepfake (intimate-image abuse) but not political deepfakes, underlining the legislative gap a campaign offence would fill.
Regulation (EU) 2024/1689 (the EU Artificial Intelligence Act), Article 50
Regulation (EU) 2024/1689 of 13 June 2024, Article 50 (transparency obligations)
The EU AI Act imposes transparency duties requiring that AI-generated or manipulated image, audio and video content (including deepfakes) be disclosed and marked as artificially generated, subject to artistic and satirical exceptions. It models a lighter-touch, disclosure-based response to synthetic media that can sit beneath a criminal offence rather than replacing it.
How the law frames it
United Kingdom
The UK has no bespoke offence for political deepfakes. It has begun criminalising other categories of harmful synthetic media: section 188 of the Online Safety Act 2023 inserted section 66B into the Sexual Offences Act 2003, covering intimate images that 'show, or appear to show' a person, which reaches deepfake intimate-image abuse, and the Data (Use and Access) Act 2025 added an offence of creating such images without consent. Election-related deception is instead policed through the Representation of the People Act 1983 (for example the false-statement offence about candidates) and general fraud and harassment law, none of which is squarely designed for AI-impersonation of candidates. That gap is the case for a tailored campaign offence.
Canada
Canada has moved fastest on the specifically electoral question. Bill C-65 (2024) amended the impersonation and misleading-publication offences in the Canada Elections Act to apply regardless of medium, manner or place, explicitly to catch deepfakes impersonating candidates or election officials, while exempting content used solely for satire or parody. The Chief Electoral Officer publicly pressed for these changes, framing them as protecting electoral integrity rather than censoring speech, which is precisely the intent-based, carve-out-protected model this essay defends.
ECHR
Article 10 ECHR protects expression including, in principle, false statements, but it is a qualified right: paragraph 2 permits restrictions prescribed by law, pursuing a legitimate aim and necessary in a democratic society, with political speech attracting heightened protection and a narrower margin of appreciation. Protecting the integrity of elections is a recognised legitimate aim, so a deepfake offence is compatible with Article 10 only if it is precisely drawn, targets intentional voter deception, and exempts satire and journalism. A blanket ban on synthetic media would fail the necessity and proportionality limbs of the test.
Counter-arguments and how to defeat them
Counter. criminalising deepfakes will chill satire and political comedy.
Rebuttal. the objection is to bad drafting, not to the principle; an offence keyed to an intent to deceive voters, confined to the campaign period and carved out for parody and journalism, punishes the forgery, not the joke, which is exactly how Canada's Bill C-65 was framed.
Counter. a deepfake is just a vivid lie, and propaganda has always existed.
Rebuttal. earlier lies still had to persuade and could be answered with more speech; a deepfake counterfeits the person and hijacks perception before reasoning begins, as the cloned-Biden robocall shows, so the marketplace-of-ideas defence runs out of time.
Counter. existing fraud and impersonation laws already cover the harm, so a new offence is redundant.
Rebuttal. the Biden case shows some conduct is already reachable, but it relied on a caller-ID statute and generic voter-suppression charges; a precise electoral-deepfake offence removes the doubt and reaches impersonation that does not happen to involve spoofed numbers.
Counter. the harm is fast, anonymous and cross-border, so criminal law cannot keep up.
Rebuttal. true, which is why the offence is necessary but not sufficient; pair it with the EU AI Act's mandatory disclosure duty and platform takedown obligations so that deterrence, labelling and removal operate together rather than relying on prosecution alone.
Counter. United States v Alvarez shows that criminalising falsehood is unconstitutional.
Rebuttal. Alvarez condemned punishing falsity that caused no demonstrable harm; an electoral-deepfake offence targets a specific, concrete harm to the integrity of the vote, which is the kind of narrowly tailored, harm-based restriction Alvarez itself leaves open.
Conclusion
The honest answer is a narrow yes. A political deepfake is not merely a louder lie; it counterfeits a person's identity and the audiovisual evidence of their conduct, and when fired into a campaign it injures the electorate's capacity to choose, a public good that defamation and slow civil remedies cannot protect. Canada's Bill C-65 shows the workable shape: extend electoral impersonation and misleading-publication offences to deepfakes regardless of medium, while expressly exempting satire and parody. Article 10 ECHR and United States v Alvarez are not obstacles but design constraints, demanding that the offence be intent-based, campaign-limited and carved out for comment, art and journalism, and underpinned by an EU-style disclosure duty rather than a blanket ban on the technology. So the law should criminalise the forger who fakes a democracy, while leaving the comedian, the journalist and the artist free.
Evidence you can cite
- The FCC adopted a $6 million forfeiture order against the operative behind the AI-cloned Biden robocall that told New Hampshire Democrats not to vote in the January 2024 primary, and he was separately indicted on counts of voter suppression and candidate impersonation.FCC, 'FCC Proposes $6M Fine For N.H. Robocalls' (2024); NPR, 'Criminal charges and FCC fines issued for deepfake Biden robocalls' (23 May 2024) โ source
- A deepfake video of President Zelensky appearing to tell Ukrainian soldiers to surrender circulated in March 2022 and was removed by Meta and YouTube within hours, but only after it had already spread, having appeared on a hacked Ukrainian news website.NPR, 'A deepfake video showing Volodymyr Zelenskyy surrendering worries experts' (16 March 2022); TechCrunch, 'Meta takes down deepfake of Ukraine's President Zelensky' (16 March 2022) โ source
- Canada's Bill C-65 (2024) extended the Canada Elections Act offences on impersonation and misleading publications to apply regardless of medium, expressly to capture deepfakes, while exempting material used solely for political satire or parody.CBC News, 'Liberal government targets deepfakes, foreign interference in major election law reforms' (2024) โ source
Further reading
- United States v Alvarez, 567 U.S. 709 (2012) (Justia)
- Bill C-65, An Act to amend the Canada Elections Act (Parliament of Canada, LEGISinfo)
- Online Safety Act 2023, s 188 and Sexual Offences Act 2003, s 66B (legislation.gov.uk)
- Regulation (EU) 2024/1689 (the EU AI Act), Article 50 transparency duties (EUR-Lex)
- FCC, '$6M Fine For N.H. Robocalls' and NPR coverage of the 2024 Biden deepfake robocall
- NPR / TechCrunch coverage of the March 2022 Zelensky surrender deepfake