AI Safety
Deepfake Incident Database
A curated database tracking verified incidents where deepfake technology has been used to target specific individuals or organizations. This collection documents cases of AI-generated synthetic media being weaponized for impersonation, manipulation, or deception, providing insights into the real-world impact and evolution of deepfake threats.
Deepfake Incident Database
| Date | Incident | Target | Type | Source |
|---|---|---|---|---|
| Jan 11, 2025 | Scammers impersonated Johnny Depp using AI deepfakes on social media to extort money from fans. The deepfakes mimicked Depp's voice and appearance to create fake accounts. | Johnny Depp and his fans | Image Video Audio | Yahoo! Voices |
| Jan 11, 2025 | Morphed images of Bollywood celebrities like Rashmika Mandanna, Alia Bhatt, and Katrina Kaif circulated widely on social media. An individual, Sanket (name changed), was blackmailed using deepfake intimate images after clicking on a malicious advertisement. 84% of social media influencers have reportedly fallen victim to deepfake pornography. | Bollywood celebrities and ordinary individuals in India | Image Video | The Indian Express |
| Jan 10, 2025 | AI-generated nude images of high school students were disseminated on social media. | high school students in Westfield, New Jersey | Image | GoErie.com |
| Jan 10, 2025 | The author of the article was deepfaked by their best friend in 2021. The deepfake involved the creation of realistic images or videos making it appear as though the victim was engaging in intimate or sexual acts without their consent. The perpetrator solicited the creation of the deepfakes. This event prompted the author to advocate for stronger legislation to protect victims of deepfake abuse. | Author of the article | Image Video | GLAMOUR UK |
| Jan 10, 2025 | Deepfake images of IVE members Jang Wonyoung and An Yujin with malicious captions were reposted on Starship Entertainment's official Weibo account before being deleted. Starship Entertainment apologized, stating it was an accident during a report of malicious posts. Fans remain unsatisfied and demand further investigation. | IVE members Jang Wonyoung and An Yujin | Image | PINKVILLA |
| Jan 09, 2025 | Deepfake videos of Dr. Naresh Trehan giving medical advice on urology were created using AI, photoshopping, and voice-over techniques. The videos falsely portrayed Dr. Trehan endorsing natural remedies for prostatitis and erectile dysfunction. They were viewed over 1.1 million times before being taken down by court order. | Dr. Naresh Trehan | Video Audio | The Indian Express |
| Jan 09, 2025 | A high school senior in Sydney, Australia allegedly used AI to create deepfake pornography of female students using images from social media. Fake social media profiles were also created. Parents and students were notified. Police launched an investigation on January 6th. The NSW Department of Education is working with police and will take appropriate action. The incident is considered illegal and abhorrent. A similar incident occurred in Victoria in June 2022. | female students at a Sydney high school | Image Video | New York Post |
| Jan 08, 2025 | A deepfake video falsely portrays UK Prime Minister Keir Starmer admitting to knowing about the Jimmy Savile investigation but dismissing claims as frivolous. The video uses AI-generated audio and manipulated video footage. Experts confirmed the video's AI manipulation and inconsistencies. The original video was from a 2012 Guardian video about social media prosecution guidelines. A previous deepfake of Starmer promoting an investment scheme was also cited. | Keir Starmer | Video Audio | Full Fact |
| Jan 07, 2025 | A deepfake porn website targeted over 30 British female politicians, including Deputy Prime Minister Angela Rayner. | Over 30 British female politicians, including Deputy Prime Minister Angela Rayner | Image Video | News Central |
| Jan 07, 2025 | A pornographic deepfake of Northern Irish politician Cara Hunter was shared before an election, leading to harassment and public questioning. | Cara Hunter | Image Video | THE DECODER |
| Jan 07, 2025 | The Guardian article discusses multiple instances of AI-generated deepfake audio. Georgina Findlay, a YouTube presenter, had her voice used in numerous videos by a far-right channel. Other examples include deepfake audio of Sadiq Khan making inflammatory remarks, David Attenborough's voice used in partisan US news, and a voice eerily similar to Scarlett Johansson's created using OpenAI technology. While specific dates aren't provided for each incident, the article highlights the increasing use of this technology for malicious purposes. | Georgina Findlay, Sadiq Khan, David Attenborough, Scarlett Johansson | Audio | The Guardian |
| Jan 07, 2025 | Deepfake pornography featuring the faces or bodies of at least 250 British celebrities superimposed onto explicit images or videos without their consent. Channel 4 News presenter Cathy Newman and former Love Island contestant Cally Jane Beech shared their experiences. The government is introducing a new offense to address this issue. | 250 UK celebrities, including Cathy Newman and Cally Jane Beech | Image Video | Mint |
| Jan 07, 2025 | From the United States to Italy, Britain, and Pakistan, female politicians are increasingly becoming victims of AI-generated deepfake pornography or sexualized images. An online boom in non-consensual deepfakes is outpacing efforts to regulate the technology globally, with cheap AI tools digitally undressing women. This imagery is used to tarnish reputations, jeopardize careers, undermine public trust, and create conditions for blackmail or harassment. In the U.S., the American Sunlight Project (ASP) identified over 35,000 instances of deepfake content depicting 26 members of Congress—25 women. Nearly one in six women in Congress have been victims. ASP did not release names to avoid public searches but privately notified offices. In the UK, Deputy Prime Minister Angela Rayner was among over 30 British female politicians targeted by a deepfake porn website. In Italy, Prime Minister Giorgia Meloni is seeking damages from two men who created deepfake porn videos of her. In Pakistan, a deepfake video of lawmaker Meena Majeed was debunked, and Information Minister Azma Bukhari was targeted by a deepfake video. | Female politicians worldwide | Image Video | The Hindu |
| Jan 07, 2025 | Social media influencer Cally Jane Beech had an AI-generated nude image created from one of her clothed photos and shared online. She found the deepfake incredibly realistic and reported it to the police, but faced difficulties due to the global nature of the hosting site and the police's unfamiliarity with this type of crime. | Cally Jane Beech | Image | Sky News |
| Jan 06, 2025 | Deepfake pornography and sexualized images targeting female politicians are spreading globally. The American Sunlight Project identified over 35,000 instances of deepfake content depicting 26 members of Congress (25 women) on pornographic sites. A Channel 4 investigation revealed that over 30 British female politicians, including Deputy Prime Minister Angela Rayner, were targeted by a deepfake porn website. Prime Minister Giorgia Meloni is suing two men for creating and distributing deepfake porn videos of her. Deepfake videos targeting female politicians have also surfaced in Pakistan, including fabricated videos of lawmaker Meena Majeed and Information Minister Azma Bukhari. | Multiple female politicians across the US, UK, Italy, and Pakistan | Image Video | The Daily Courier |
| Jan 05, 2025 | A Hong Kong deepfake scam group used deepfakes to impersonate wealthy, single women to defraud victims in Taiwan, Singapore, and Malaysia. Recruits were trained to discuss topics such as expensive red wine and golf, and to learn about victims' finances and cryptocurrency investments to build trust. Over HK$34 million in scam proceeds were intercepted by police. | Individuals in Taiwan, Singapore, and Malaysia | Image Video Audio | South China Morning Post |
| Jan 03, 2025 | Dozens of AI-generated videos depicting Donald Trump making various statements have circulated on social media in Kenya and Nigeria. In Kenya, a deepfake video of Trump threatening to withhold U.S. aid went viral on TikTok and X. In Nigeria, videos showed Trump announcing changes to U.S.-Nigeria immigration policy and calling for the release of Nnamdi Kanu, threatening aid withdrawal if Kanu wasn't released by November 31, 2024. Both videos contained inconsistencies like mismatched lip movements, and claims were unsubstantiated. | Kenya and Nigeria | Video | VOA Asia |
| Jan 02, 2025 | A Royal Air Force veteran, Jonathan Bates (54), received a five-year prison sentence for creating and distributing deepfake pornography of his ex-wife and three other women, whom he stalked for years. The images were posted on pornographic websites, including fake profiles advertising sexual services. The victims suffered severe impacts on their personal and professional lives, including fear, humiliation, and job loss. Police recovered thousands of images from his home. Despite efforts to remove the content, prosecutors stated the images would likely remain online indefinitely. Bates pleaded guilty to four counts of stalking and one count of revenge porn against his ex-wife. Each victim received a 10-year restraining order. | ex-wife and three other women | Image Video | New York Post |
| Jan 02, 2025 | During the Delhi assembly elections in late 2024, the Aam Aadmi Party (AAP) and the Bharatiya Janata Party (BJP) used deepfakes from shows like *Panchayat* and *Maharani*. BJP depicted AAP chief Arvind Kejriwal negatively, while AAP retaliated with deepfakes promoting their schemes. A deepfake of Pankaj Tripathi criticizing BJP was also shared. Other incidents involved Ranveer Singh, Kanchan Nagar, and Rajat Sharma. Zomato also faced criticism for using generative AI to create videos featuring celebrities without permission. | Arvind Kejriwal, Atishi Marlena, BJP, AAP, Ranveer Singh, Kanchan Nagar, Rajat Sharma | Video Image | afaqs! |
| Dec 30, 2024 | A 17-year-old girl, Jaylyn Lee, pleaded not guilty to eight counts of promoting an altered sexual depiction of an identifiable person without consent. Lee is accused of distributing AI-generated nude photos of 14 high school girls. The photos were allegedly created by her 18-year-old ex-boyfriend using an AI app. Lee obtained the photos from her ex-boyfriend's phone, kept them for a month, and then sent them to 17 high school students, some of whom were not depicted in the images. Police stated that the creation or possession of AI-generated nude photos isn't illegal, but distributing them is. While the victims' parents want the ex-boyfriend charged, police say he didn't break any laws because he didn't distribute the photos. Lee's next court date is January 30th. | 14 high school girls | Image | Pensacola News Journal |
| Dec 30, 2024 | AI-generated deepfake images of Taylor Swift circulated on social media, causing widespread outrage. Microsoft responded by improving its deepfake prevention tools. | Taylor Swift | Image | Cornwall Live |
| Dec 31, 2024 | AI-generated deepfakes of Indian politicians were used to spread misinformation during elections. Fake videos of politicians making false claims (e.g., Amit Shah on ending reservations, Supriya Sule on Bitcoin fraud) were created and circulated. Deepfake videos of business leaders promoting investment scams also appeared. Similar tactics were used internationally, including in the Israel-Hamas conflict and in Bangladesh. | Multiple political figures in India (Amit Shah, Supriya Sule, etc.) and business leaders (Mukesh Ambani, Sundar Pichai, Elon Musk, etc.) | Video Audio Image | Vishvas News English |
| Dec 30, 2024 | A 17-year-old girl, Jaylyn Lee, pleaded not guilty to eight counts of promoting an altered sexual depiction of an identifiable person without consent. Lee is accused of distributing AI-generated nude photos of 14 high school girls. The photos were allegedly created by her 18-year-old ex-boyfriend using an AI app. Lee obtained the photos from her ex-boyfriend's phone, kept them for a month, and then sent them to 17 high school students, some of whom were not depicted in the images. Police stated that the creation or possession of AI-generated nude photos isn't illegal, but distributing them is. While the victims' parents want the ex-boyfriend charged, police say he didn't break any laws because he didn't distribute the photos. Lee's next court date is January 30th. | 14 high school girls | Image | Pensacola News Journal |
| Dec 30, 2024 | AI-generated deepfake images of Taylor Swift circulated on social media, causing widespread outrage. Microsoft responded by improving its deepfake prevention tools. | Taylor Swift | Image | The Economic Times |
| Dec 28, 2024 | A classmate created deepfake nude images of them using AI. Police declined to press charges due to legal ambiguities and insufficient evidence of distribution. The girls suffered emotional distress. | group of Toronto high school girls | Image | Toronto Star |
| Dec 27, 2024 | The author of a Channel 4 news report, along with numerous other celebrities and public figures, became victims of deepfake pornography. An investigation revealed millions of views across multiple websites. The article highlights the dehumanizing and violating experience for victims, the slow implementation of regulations, and the continued online presence of deepfakes despite notifications to tech companies. The case of Sophie Parrish, a 31-year-old florist, is used to illustrate the severe emotional distress caused by deepfake nudes. | The author of the Channel 4 news report, along with several other celebrities (Taylor Swift, Jenna Ortega, Alexandra Ocasio-Cortez, Georgia Meloni) and other public figures | Video | Channel 4 News |
| Dec 26, 2024 | Deepfake images of Indian actors Deepika Padukone and Ranveer Singh with their infant daughter, and of actors Rashmika Mandanna and Vijay Deverakonda, circulated on Instagram. The images appeared in Instagram search results and garnered numerous likes despite being absent from the actors' official accounts. The origin of the deepfakes is unclear, and the images lacked AI-generated content labels. | Deepika Padukone, Ranveer Singh, Rashmika Mandanna, Vijay Deverakonda | Image | The Hindu |
| Dec 21, 2024 | A deepfake audio of President Biden urging Democrats not to vote in the New Hampshire primary was created by a Democratic political consultant. This resulted in a $6 million FCC fine and criminal charges. | Democratic voters in New Hampshire primary | Audio | NPR |
| Dec 21, 2024 | Multiple deepfake images of Pope Francis have been generated and circulated online. These include images showing him with Madonna, wearing a Balenciaga puffer jacket, holding a Pride flag, on a beach, and with his face merged with that of an alleged murderer. The images were created using both paid platforms like Krea.ai and freely available models like Stable Diffusion. The creator, RickDick, stated that the images were intended as satire. | Pope Francis | Image | The Guardian |
| Dec 19, 2024 | A 77-year-old woman, Nikki MacLeod, was defrauded of £17,000 through a romance scam involving AI-generated deepfake videos. The scammer, posing as a woman named Alla Morgan working on an oil rig, used the videos to build trust and then requested increasing sums of money under various fabricated pretenses. While some funds were recovered, personal payments sent via PayPal were not. A cybersecurity expert confirmed the videos' manipulation. | Nikki MacLeod | Video | BBC.com |
| Dec 18, 2024 | A 15-year-old girl was victimized by AI-generated deepfake pornography. This prompted Congressional action to mandate social media platforms and websites to remove non-consensual, AI-created pornographic images. | 15-year-old girl | Image Video | CBS News |
| Dec 18, 2024 | A classmate used AI to manipulate a picture of 15-year-old Elliston Berry from her Instagram, removing her dress and distributing the altered image on Snapchat. The image circulated for nine months. This incident prompted Elliston Berry to urge Congress to pass the Take It Down Act. | 15-year-old Elliston Berry | Image | CBS News |
| Dec 17, 2024 | A study by the American Sunlight Project (ASP) found that women in the U.S. Congress are 70 times more likely to be victims of deepfake pornography than their male counterparts. The study analyzed 11 websites and found 26 members of Congress (25 women and one man) in deepfake content. Content targeting 14 members was removed within 48 hours of ASP notification. | Women US lawmakers | Image Video | USA TODAY |
| Dec 17, 2024 | Over 35,000 mentions of nonconsensual intimate imagery (NCII) targeting primarily female members of Congress were found on deepfake websites. The American Sunlight Project (ASP) found that women in Congress are 70 times more likely to be targeted than men. While most imagery was quickly removed after researchers contacted the affected lawmakers, the material can be easily re-shared. The impact extends beyond politics, with high school girls also being targeted. The lack of federal legislation poses risks to national security. | 25 female members of Congress and other women in public life | Image Video | South Carolina Daily Gazette |
| Dec 12, 2024 | AI voice generator Lovo allegedly cloned the voices of voice actors Lehrman and Sage using recordings obtained through Fiverr, without their consent. The actors were misled about how their voice recordings would be used and later discovered that their voices were used commercially on Lovo's platform and in a podcast, under pseudonyms. A lawsuit alleging misuse of voice, copyright infringement and other claims has been filed. | Lehrman and Sage | Audio | The National Law Review |
| Dec 11, 2024 | Two teenage boys created and distributed 347 AI-generated deepfake pornographic images and videos of approximately 60 high school girls using photos from their public social media accounts. The images were shared within the school community. The boys were criminally charged with sexual abuse of children and possession of child pornography. This is considered the largest known instance of this crime involving minors in the US. Parents filed lawsuits against the school for negligence. | Approximately 60 high school girls, mostly from Lancaster Country Day School | Image Video | Forbes |
| Dec 10, 2024 | Houston businessman Gary Cunningham lost $20,000 after criminals cloned his voice using AI to impersonate him to his accountant. In November, a fraudulent wire transfer was initiated, diverting funds to a new bank account. His email had been hacked and his voice cloned. A police report has been filed. | Gary Cunningham | Audio | FOX 26 Houston |
| Dec 04, 2024 | Deepfake ads on YouTube featuring celebrities like Arnold Schwarzenegger, Sylvester Stallone, Mike Tyson, Terry Crews, Tom Hanks, Denzel Washington, and Johnny Sins promoting an erectile dysfunction supplement called "Prolong Power". The ads used AI-generated voices and lip syncing on modified existing videos. The ads directed users to websites with a 40-minute presentation making exaggerated and unsubstantiated claims. Google removed the ads and suspended the account. | YouTube users | Video Audio | 404 Media |
| Dec 04, 2024 | Over 1,100 fraudulent loan application attempts and over 1,000 fraudulent accounts were created using AI-generated deepfake images to bypass biometric verification systems, including liveness detection. Attackers obtained victim IDs through illicit channels (malware, social media, dark web), manipulated the images, and used them to deceive the system. Attackers used AI-generated deepfakes to bypass biometric verification and liveness detection. They also employed virtual camera software and app cloning to manipulate biometric data and simulate multiple devices. Potential losses in Indonesia alone are estimated at $138.5 million. | A prominent Indonesian financial institution | Image Video | Forbes |
| Nov 29, 2024 | A BBC journalist used AI-generated voice cloning technology to bypass the voice ID systems of Santander and Halifax banks by using a recording of her AI-cloned voice saying, "My voice is my password." This highlights the vulnerability of current biometric security measures. | Santander and Halifax banks | Audio | CX Today |
| Nov 27, 2024 | A BBC reporter successfully accessed their bank accounts at Santander and Halifax using an AI-generated clone of their voice. A readily available recording of the reporter's voice was used to create the deepfake. Basic audio equipment was sufficient to bypass security measures. | Santander and Halifax bank accounts | Audio | BBC.com |
| Nov 25, 2024 | A scammer created a deepfake video of Amanda Aguilar and used it on Facebook to contact John Pulido. The scammer, posing as Aguilar, attempted to obtain financial information from Pulido. The deepfake video was convincing enough to initially fool Pulido, but he became suspicious due to requests about his income and requested video proof. | Amanda Aguilar | Video | NBC Washington |
| Nov 25, 2024 | A user was able to clone Kamala Harris' voice and generate inappropriate speech using PlayAI's text-to-speech tool, bypassing the platform's safeguards. PlayAI's community portal also contained content with explicit titles. | Kamala Harris | Audio | TechCrunch |
| Nov 25, 2024 | The voices of several public figures, including Sir David Attenborough, Sir Michael Parkinson, and Bill Gates, were cloned and used without their consent in various scenarios, including fraudulent advertisements and scams. A school principal received death threats via a deepfake audio clip. A CEO's voice was cloned in an attempt (unsuccessful) at corporate espionage. | multiple individuals and organizations | Audio | BBC.com |
| Nov 24, 2024 | A convincing fake Microsoft Teams meeting resulted in a $25 million loss to cybercriminals. | Unspecified business | Audio | eWeek |
| Nov 24, 2024 | Deepfakes of Elon Musk were used in cryptocurrency investment scams, resulting in billions of dollars in losses. One victim, Heidi Swan, lost over \$10,000. The FTC and BBB have issued warnings. The ease of creating these deepfakes was demonstrated using readily available AI tools. Deepfake detection websites show varying accuracy. | Elon Musk | Video Image | CBS News |
| Nov 23, 2024 | Des Healey, a Brighton kitchen fitter, lost £76,000 to a deepfake scam using the likenesses and voices of Martin Lewis and Elon Musk in a fake Facebook advert promoting a Bitcoin investment scheme. He invested his life savings and took out multiple loans before his son alerted him to the scam. Two banks have since canceled his loans, but he still owes approximately £26,000. | Des Healey | Image Video Audio | BBC.com |
| Nov 18, 2024 | David Attenborough's voice was cloned and used in AI-generated deepfakes on YouTube videos about the Ukraine-Russia war and Donald Trump. Attenborough expressed concerns about his identity being stolen and used to promote messages he doesn't endorse. One deepfake creator claimed they weren't impersonating him, despite the obvious similarities. | David Attenborough | Audio | Deadline |
| Nov 15, 2024 | Fake audio messages were used in New Hampshire in January to discourage voting. These messages used a deepfake of President Biden's voice. | voters in New Hampshire | Audio | University of Florida |
| Nov 01, 2024 | A fake AI-generated image of an explosion near the Pentagon circulated on social media, causing temporary market disruption. | financial markets | Image | Center for Strategic & International Studies |
| Oct 30, 2024 | The text describes several types of deepfake scams, including investment scams targeting an 82-year-old who lost \$690,000 to a deepfake Elon Musk, romance scams in Hong Kong resulting in over \$46 million in losses, political scams using AI-generated audio of Joe Biden, extortion scams (grandparent scams) resulting in over \$13 million in losses from January 2020 to June 2021, and celebrity endorsement scams featuring Taylor Swift. Specific details about each incident, such as exact dates and victims names are not provided. | Multiple individuals and groups | Image Video Audio | National Council on Aging |
| Oct 29, 2024 | Scammers used AI to clone Sunil Mittal's voice to attempt to defraud him. The attempt was unsuccessful, but others have lost money to similar scams. | Sunil Mittal | Audio | The Indian Express |
| Oct 28, 2024 | Dozens of Wiz employees received a deepfake voice message seemingly from the CEO, Assaf Rappaport. The deepfake used audio of Rappaport from a conference. The attack aimed to obtain employee credentials. The source of the audio was traced, but the perpetrators remain unidentified. | Wiz employees | Audio | TechCrunch |
| Oct 17, 2024 | Anthony was scammed out of $25,000 after fraudsters used AI to replicate his son's voice. The scammers called, claiming his son had been in an accident and needed bail money. Anthony sent money via Uber drivers who were unaware of the scam. Police confirmed the use of AI voice cloning and warned about the scammers' tactics. | Anthony | Audio | ABC7 Los Angeles |
| Oct 15, 2024 | In early 2020, a Telegram bot was discovered that generated over 100,000 explicit AI-generated images, including those of children. A recent investigation revealed at least 50 Telegram bots claiming to create explicit photos and videos with minimal input, boasting over 4 million combined monthly users. These bots are often supported by associated Telegram channels with millions of subscribers, advertising new features, and offering "tokens" for use. Many bots clearly advertise their function—creating nude or sexually explicit images of women. Some require users to pay for tokens to use the service. One bot, with over 300,000 users, deceptively hid its explicit function behind a non-explicit name and landing page. Following WIRED's contact, Telegram removed 75 identified bots and channels; however, additional channels and bots quickly appeared. | Women and children | Image Video | WIRED |
| Oct 15, 2024 | A romance scam using deepfake AI resulted in losses exceeding $46 million. 28 people were arrested for creating realistic online personas of attractive women to build relationships with victims and coerce them into investing in a fake cryptocurrency platform. A training manual detailed methods to manipulate victims' emotions and trust. This followed a similar case where a Hong Kong company lost $25 million. | Men across Asia | Image Video | CNN |
| Oct 04, 2024 | A deepfake audio clip was created making it seem like the principal made racist and antisemitic comments. This led to death threats, administrative leave for the principal, and significant community division. The creator of the deepfake, the school's athletics director, was charged and is awaiting trial. | Eric Eiswert, principal of a high school in Baltimore suburb | Audio | BBC.com |
| Oct 02, 2024 | Scammers used AI to clone Jay Shooster's voice to convince his parents to send $30,000. They falsely claimed Shooster was in a car accident and needed bail money. Only 15 seconds of Shooster's voice from a recent TV appearance were used to create the AI clone. | Jay Shooster's parents | Audio | NDTV |
| Sep 30, 2024 | In early September 2024, Senator Ben Cardin (D-Md.) received a deepfake Zoom call from an imposter posing as Ukrainian Foreign Minister Dymtro Kuleba. The imposter asked politically charged questions, arousing suspicion. The call was ended, and the Department of State confirmed its inauthenticity. Senator Cardin reported the incident, and an investigation is underway. | Senator Ben Cardin | Audio Video | Dark Reading |
| Sep 27, 2024 | A woman received a call from a voice convincingly mimicking her daughter, demanding a $1 million ransom. While she confirmed her daughter's safety, the incident highlights the sophistication of these scams. | woman | Audio | BECU |
| Sep 26, 2024 | An AI-generated deepfake impersonating Dmytro Kuleba, the former Ukrainian Minister of Foreign Affairs, initiated a video call with Senator Ben Cardin. The deepfake was sophisticated enough to fool initial observation, but inconsistencies were detected, and the call was ended. The incident is considered a targeted attack highlighting the increasing sophistication and potential for future deepfake attacks. | Senator Ben Cardin | Video Audio | The Associated Press |
| Sep 25, 2024 | Elecrow, an electronics manufacturer, used AI to clone the voice of YouTuber Jeff Geerling to promote their products in video tutorials. The cloning was discovered by a subscriber and confirmed by Geerling. Elecrow's CEO apologized and offered compensation. The incident was publicized to raise awareness about AI voice cloning. | Jeff Geerling | Audio | Forbes |
| Sep 25, 2024 | An individual impersonating former Ukrainian Foreign Minister Dmytro Kuleba contacted Senator Ben Cardin via Zoom. The impersonator's voice was likely AI-generated, and the conversation involved politically charged questions about supporting long-range missiles into Russia. The incident was reported to the Senate security office and the FBI and is believed to be an attempt to use the conversation for propaganda purposes, potentially by a Russian government actor. | Ben Cardin | Audio Video | Punchbowl News |
| Sep 18, 2024 | In a deepfake incident, Hong Kong police investigated a case where an employee was tricked into transferring HK$200 million ($20 million USD) to fraudsters who used a deepfake video conference call impersonating company officers. The fraudster likely used AI to add fake voices to pre-downloaded videos. | Hong Kong company employee | Audio Video | The Guardian |
| Sep 18, 2024 | Criminals are using AI to clone voices from just three seconds of audio, obtained from publicly available online content. The AI-powered scam involves cloning a victim's voice and then cold-calling their loved ones to request money. Hundreds of cases have been reported by Starling Bank, and data suggests 28% of UK adults have been targeted. | UK adults | Audio | Entrepreneur |
| Sep 03, 2024 | Scammers stole $25 million from British engineering group Arup by impersonating the CFO using deepfake technology. A staff member transferred funds to Hong Kong accounts after a video conference with the fraudulent CFO and other AI-generated employees. | Arup | Video Audio | CFO Dive |
| Aug 31, 2024 | Lovo, a text-to-speech platform, allegedly obtained voice recordings from Paul Skye Lehrman and Linnea Sage through deception on Fiverr, claiming the recordings were for "research into speech synthesis." Lovo then allegedly created AI clones of their voices and sold them without permission or proper compensation. A lawsuit was filed alleging violations of rights of publicity and breach of contract. | Paul Skye Lehrman and Linnea Sage | Audio | BBC.com |
| Aug 29, 2024 | Multiple scam campaigns using deepfake videos of public figures to promote fake investment schemes and government giveaways. The campaigns were conducted in multiple languages and targeted various countries. A significant number of domains were used, and analysis suggests a single threat actor group was responsible. The Quantum AI campaign is highlighted as an example, using videos featuring Elon Musk, Tucker Carlson, Lee Hsien Loong, and Tharman Shanmugaratnam with AI-generated audio and lip-syncing. | Multiple individuals including Elon Musk, Tucker Carlson, Lee Hsien Loong, and Tharman Shanmugaratnam, and various government entities | Video Audio | Unit 42 |
| Aug 21, 2024 | AI-generated robocall impersonating President Biden's voice, urging voters not to vote. Orchestrated by political consultant Steve Kramer, who faces separate penalties. Lingo Telecom, the voice service provider, paid a $1 million fine. | New Hampshire Democratic primary voters | Audio | NBC News |
| Aug 15, 2024 | A robocall featuring an AI-generated voice of President Biden urged Democrats not to vote in the New Hampshire primary. Paul Carpenter created the deepfake and was paid $150 by Steve Kramer, a political consultant who faces charges related to the robocall. The Phillips campaign denied involvement. | Democratic voters in the New Hampshire primary | Audio | CBS Boston |
| Aug 01, 2024 | A manipulated audio and video clip of Kamala Harris was shared by Elon Musk on X, sparking debate about deepfakes and their regulation. The deepfake, viewed over 150 million times, included edited clips and comments on diversity, Biden, and border policies. Similar deepfakes targeting other politicians have also emerged. | Kamala Harris | Audio Video | NBC News |
| Jul 09, 2024 | Robocalls with a deepfake of President Biden's voice discouraged voters in the 2024 New Hampshire presidential primary. The alleged perpetrator was charged with felonies and misdemeanors related to voter suppression and impersonation, and faces a potential $6 million fine from the FCC. | New Hampshire primary voters | Audio | The Fulcrum |
| Jul 03, 2024 | A Baltimore high school principal was falsely depicted making racist and anti-Semitic remarks in a deepfake audio clip shared over 27,000 times. This led to his temporary suspension until the deepfake was proven false, resulting in a teacher's arrest. In February 2023, students in Putnam County, New York, created a deepfake video of their principal making violent threats. While disciplinary action was taken, some parents felt the school's response was insufficient. In October 2023, male students in New Jersey created pornographic deepfakes of female classmates, leading to parental criticism of the school's response. A Seattle-area high school failed to report a similar incident to law enforcement, highlighting the legal obligation to report such cases involving minors. | Baltimore high school principal;Putnam County, New York principal;female students in New Jersey;female classmates in Seattle-area high school | Audio Video | Atkinson, Andelson, Loya, Ruud & Romo |
| Jun 26, 2024 | Two voice actors, Paul Skye Lehrman and Linnea Sage, are suing AI company Lovo for using their voice clips to train an AI voice cloning tool without consent. Their voices were allegedly used in YouTube videos and podcasts. | Paul Skye Lehrman and Linnea Sage | Audio | CBS News |
| Jun 17, 2024 | A deepfake video ad was created by a rival PAC during a Shreveport mayoral race. The ad falsely depicted Perkins as a student being scolded by a principal for failing to keep communities safe and create jobs. Perkins lost his reelection bid and believes the deepfake ad was a significant factor. | Adrian Perkins | Video | PBS NewsHour |
| May 31, 2024 | In January 2024, a deepfake of President Biden's voice, created using ElevenLabs' technology, circulated before the New Hampshire primary. In March 2024, a fabricated recording of a Slovakian presidential candidate falsely boasting about election rigging and price increases went viral, potentially influencing the election results. | President Biden, Rishi Sunak, Ursula von der Leyen, Slovakian presidential candidate | Audio | Oregon Public Broadcasting |
| May 29, 2024 | In January 2024, a Hong Kong firm lost US\$25 million to fraudsters using a deepfake video call to impersonate executives. | A Hong Kong firm | Video | Deloitte |
| May 23, 2024 | AI-generated deepfake robocall impersonating President Biden discouraged voters in New Hampshire's January primary. Political consultant Steve Kramer faces $6 million fine from the FCC and criminal charges for the incident. | Democratic voters in New Hampshire | Audio | NPR |
| May 09, 2024 | Approximately 5,000 New Hampshire voters received a robocall featuring an AI-generated voice of Joe Biden urging them not to vote in the primary, suggesting their votes would benefit Republicans. The software used was from ElevenLabs, requiring only a few hours of voice samples to create a convincing clone. | New Hampshire voters | Audio | The Atlantic |
| Apr 10, 2024 | An AI-generated voice impersonating President Joe Biden was used in a telephone message urging New Hampshire voters to abstain from the presidential primary. Election officials are investigating this incident. | New Hampshire voters | Audio | VOA Learning English |
| Apr 01, 2024 | Imran Khan, Pakistan's jailed former Prime Minister, used AI-generated speeches to reach supporters before the February parliamentary elections. A political operative for Dean Phillips used a robocall impersonating President Joe Biden to discourage voters in the New Hampshire Democratic primary. | Imran Khan, Joe Biden | Audio | Al Jazeera English |
| Mar 11, 2024 | A synthesized version of Will Trapp's voice was used in a phone call scam. The callers, posing as a police officer and then a public defender, instructed Trapp's parents to withdraw $15,000 for his bail after a fake car accident. | Will Trapp's parents | Audio | Mustang News |
| Mar 07, 2024 | A Brooklyn couple, Robin and Steve, were targeted in a deepfake voice scam where the scammers convincingly mimicked the voice of Steve's mother, Mona, to extort money. The scammers demanded money, claiming to hold Mona hostage. After receiving the money via Venmo, they hung up. Mona was unharmed. | Robin and Steve | Audio | The New Yorker |
Deepfake Reports
Deepfake Impersonation Targeting Senator Ben Cardin
Date of Incident: Mid-September 2024Target: Senator Ben Cardin, Chair of the Senate Foreign Relations CommitteeNature of Incident: Sophisticated deepfake impersonation of a high-ranking Ukrainian official In mid-September 2024, Senator Ben Cardin was targeted by a...
Justin Bieber AI-Generated Deepfake Song referencing Sean “Diddy” Combs
In April 2024, an AI-generated song purportedly performed by Justin Bieber began circulating widely on social media platforms, particularly TikTok and YouTube. The song, which included lyrics referencing Sean "Diddy" Combs, initially deceived many listeners into...
LeBron James Olympic Team USA Criticism
On August 9th, 2024, a social media post containing an alleged audio clip of NBA star LeBron James criticizing Team USA head coach Steve Kerr went viral. The post, made by Twitter user @RealRobReinhart, claimed to have obtained "locker room audio" of James disparaging...
Malaysian singer Siti Nurhaliza deepfake
Overview Malaysian singer Siti Nurhaliza has warned her fans about a viral scam using AI-generated calls, deepfake videos, and images to deceive people into believing she is offering cash rewards or organizing contests. The scammers have hijacked her voice, likeness,...
Joe Biden call to Kamala Harris
A controversy has emerged regarding the authenticity of Joe Biden’s phone call to Kamala Harris, during her speech to campaign staff members in Delaware. Allegations have circulated that this call was a deepfake, artificially generated using advanced AI technology....
Analysis of the Scarlett Johansson and Open AI Sky AI Voice Controversy
The Scarlett Johansson-Open AI Sky AI voice controversy erupted when OpenAI unveiled its new AI assistant with voice capabilities, featuring a voice called "Sky" that many users found eerily similar to Johansson's voice from the movie "Her." Background In May 2024,...
LastPass CEO Audio Deepfake Incident
LastPass revealed that one of its employees was targeted in a sophisticated voice phishing attack. The attackers used deepfake audio technology to impersonate Karim Toubba, the CEO of LastPass, in an attempt...
Arcads AI Deepfake Video
On March 25, 2024, a Twitter user named Beck (@beckylitv) posted a 46-second video that was created using artificial intelligence (AI) technology, specifically the Arcads.ai platform. The video featured a deepfake of an unidentified woman delivering a script in a car....
Cal Poly AI Voice Cloning Scam Case
A recent incident at Cal Poly has highlighted the growing concern over AI voice cloning and its use in phone scams. A family associated with Cal Poly was targeted by scammers who utilized AI voice cloning technology. This technology allows for the creation of...
Deepfake Leads to $25 Million Loss: Employee Tricked by Deepfake CFO
A finance worker at a multinational firm was defrauded of $25 million in an elaborate scam involving deepfake technology. The employee was tricked into participating in a video call with several individuals he believed to be colleagues, including the company's...
Deepfake Black Celebrities: AI Misinformation on YouTube
Fake news creators on YouTube have been exploiting artificial intelligence (AI) and automated tools to generate and disseminate misinformation targeting Black celebrities, creating a significant challenge in the digital information landscape. This trend of deepfake...
Fake Joe Biden robocall: AI-Generated Election Interference
In a startling incident that underscores the potential misuse of artificial intelligence in politics, a robocall featuring an AI-generated voice resembling President Joe Biden circulated in New Hampshire, causing...
More From Resemble AI
Resemble AI Partners with Carahsoft to Bring Voice AI and Deepfake Detection to the Public Sector
We are thrilled to announce our strategic partnership with Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®. This collaboration marks a significant milestone in our mission to bring cutting-edge voice AI technology and advanced deepfake...
Our Commitment to Consent
Remember when creating a synthetic voice meant hours in a studio, carefully recording every syllable? Now, with a few clicks, you can clone anyone's voice. It's mind-blowing tech. But with great power comes great responsibility. At Resemble, we've always believed that...
Introducing ‘Edit’ by Resemble AI: Say No More Beeps
In audio production, mistakes are inevitable. You’ve wrapped up a recording session, but then you notice a mispronounced word, an awkward pause, or a phrase that just doesn’t flow right. The frustration kicks in—do you re-record the whole segment, or do you spend...