AI Safety

Deepfake Incident Database

A curated database tracking verified incidents where deepfake technology has been used to target specific individuals or organizations. This collection documents cases of AI-generated synthetic media being weaponized for impersonation, manipulation, or deception, providing insights into the real-world impact and evolution of deepfake threats.

Date Incident Target Type Source
Jun 22, 2025 A middle school teacher in Florida, David McKeown, was arrested for allegedly downloading and sharing child pornography and animal abuse images. Some of the images may have been AI-generated using photos of his students. He allegedly used school internet to download and share the images. Students of UBIC Academy Image New York Post
Jun 22, 2025 North Korean hackers deepfaked the company's leadership team in a Zoom call to trick a crypto employee. They used a malicious Zoom extension to install malware on the employee's macOS. Crypto employee Video Komando.com
Jun 22, 2025 AI-generated obituaries created using harvested data from social media posts about the deceased. These obituaries contained inaccuracies, distortions, and even false information about the cause of death and funeral arrangements. YouTube videos were also created with AI voiceovers reading the fake obituaries accompanied by stock photos. Jamie (deceased) and her family Audio Image CNET
Jun 21, 2025 Iranians abroad are encountering AI voices answering calls to family in Iran. The voices deliver unsettling messages, possibly a government tactic to disrupt communication or spread confusion amidst rising tensions. Iranian diaspora attempting to contact family in Iran Audio Times of India
Jun 21, 2025 When Iranian citizens living abroad attempt to call their family in Iran, they are met with strange, robotic voices. These voices say unusual things and prevent the caller from reaching their family member. Security experts suspect the Iranian or Israeli government is behind the incident. Iranian citizens living abroad trying to contact family in Iran Audio The Indian Express
Jun 21, 2025 During the Israel-Iran conflict, Iranians living abroad are encountering AI voices answering their calls to family in Iran. These voices deliver disturbing pre-recorded messages and are believed to be government tactics to control information or potentially a tactic employed by Israel to spread confusion. Iranians living abroad Audio Republic World
Jun 21, 2025 Iranians abroad reported hearing AI-generated voices, specifically one calling itself 'Alyssia,' when attempting to call relatives in Iran. This occurred amidst rising tensions between Iran and Israel and coincided with internet and phone blackouts imposed by the Iranian government. The AI voice replaced real conversations, causing confusion and alarm, with some suspecting psychological warfare. Iranians abroad attempting to contact relatives in Iran Audio thedailyjagran.com
Jun 21, 2025 An AI-generated video was falsely shared on social media platforms (X, TikTok, Facebook, Instagram) claiming to show the destruction in Tel Aviv after an Iranian attack. The video, created using Google AI, was identified by a watermark. The video predates the attack and was originally posted with hashtags related to South Lebanon. Tel Aviv, Israel Video Yahoo
Jun 21, 2025 Falsified footage of United Kingdom-based activist Tommy Robinson’s viral migrant‑landing video. Tommy Robinson Video The Indian Express
Jun 21, 2025 Iranians abroad are encountering strange, robotic voices when calling their homes in Iran. These voices use phrases to prevent contact and possibly gather information. Experts suspect the Iranian government or potentially Israel is responsible, using low-tech AI or pre-recorded messages to divert calls. Iranians attempting to contact family in Iran Audio WION
Jun 21, 2025 A middle school teacher was arrested for allegedly using student photos to create AI-generated pornography and sharing child pornography on Discord. Students of a middle school in Central Florida Image FOX 35 Orlando
Jun 20, 2025 During the Israel-Iran conflict, AI-generated videos and images were used to spread disinformation. Examples include fake videos boasting of Iran's military capabilities and fake clips showing the aftermath of strikes on Israeli targets. AI-generated images exaggerated the success of Iran's response, such as depicting missiles falling on Tel Aviv and claims of destruction of Israeli F-35 fighter jets. Pro-Israeli accounts also shared disinformation, including AI-generated videos purporting to show Iranians chanting 'we love Israel'. State media in Tehran shared fake footage of strikes and an AI-generated image of a downed F-35 jet. The disinformation was spread on X, TikTok, and Instagram. Israeli government, Iranian government, general public Video Image BBC
Jun 20, 2025 A middle school teacher in Florida, David McKeown, was arrested for allegedly using real student photos to create AI-generated pornographic images. He is accused of sharing and downloading child pornography, potentially using students' photos to create the AI-generated content. The investigation began after a tip from the National Center for Missing and Exploited Children. Devices were seized from his home and the school, and he faces multiple charges related to child sex abuse material. Students of UBIC Academy Image FOX 35 Orlando
Jun 20, 2025 Iranians living abroad receive strange, robotic voices when attempting to call their loved ones in Iran. The voices deliver bizarre messages, causing distress and hindering communication during a time of crisis and conflict. Iranian citizens and their relatives abroad Audio AP News
Jun 20, 2025 Midjourney's AI video tool V1 generated short animated clips of Disney and Universal characters (e.g., Wall-E, Yoda) in potentially infringing or inappropriate scenarios (e.g., Wall-E holding a gun, Yoda smoking a joint). This occurred despite some guardrails intended to block such generation. Disney and Universal have filed a lawsuit against Midjourney, alleging copyright infringement. Disney, Universal Video WIRED
Jun 20, 2025 Midjourney's AI video tool V1 generates animated clips of copyrighted characters from Disney and Universal, including Wall-E holding a gun. Disney and Universal filed a lawsuit against Midjourney, alleging copyright infringement. Guardrails are incomplete, allowing generation of clips of characters like Homer Simpson, Shrek, Minions, Deadpool, C-3PO, and Darth Vader. It was possible to generate clips of copyrighted characters in adult situations, like Wall-E brandishing a firearm and Yoda smoking a joint. Disney and Universal (copyrighted characters) Video Image WIRED
Jun 20, 2025 Scammers are using deep fakes to impersonate victims’ family members in order to steal their money. Malicious actors have been creating texts or deepfaked audio messages that impersonate top government officials, part of a scam to trick current or former senior federal and state government leaders. Seniors, families, small business owners, government officials Audio CyberScoop
Jun 20, 2025 A viral TikTok video depicted a news anchor alleging that Iran planned to invade Florida. The video was generated by AI and spread panic across social media. The video contains red flags, such as an unnamed news anchor, unnatural pauses, an eight-second clip, and a map with geographical inaccuracies. The video lacks branding to identify the news anchor or network. Florida, USA Video Pensacola News Journal
Jun 20, 2025 Music streamer Deezer is flagging AI-generated songs due to a surge in music created using AI tools, which are being used to fraudulently earn royalties. Deezer has detected that 18% of songs uploaded to its platform each day are completely AI generated. Fraudsters are creating and uploading AI-generated songs to streaming platforms, trying to get them onto playlists and recommendations, and earning royalties as a result. Deezer is fighting this by flagging AI-generated content and cutting off royalty payments for AI songs used for stream manipulation. A specific case is mentioned where a man was charged with generating hundreds of thousands of AI songs and using bots to stream them billions of times, earning at least $10 million. Deezer, musicians, copyright holders Audio New York Post
Jun 20, 2025 A digitally created image falsely depicts Donald Trump with a teenage girl, falsely implying a connection to Jeffrey Epstein's island. The image contains AI-related errors, such as distorted body parts. Trump's spokesperson confirmed the image as fake. Donald Trump Image Full Fact
Jun 20, 2025 An AI-generated video falsely depicts Israeli citizens protesting and pleading with Iran to stop the war. The video contains inconsistencies like unnatural facial features, spelling errors and a 'Veo' watermark. AI detection tools confirmed it was AI-generated. Israel Video FACTLY
Jun 20, 2025 Mai Fujimoto, a crypto influencer, had her X, Telegram and Metamask accounts compromised after being induced to click a link during a Zoom call with a compromised account of her acquaintance. Mai Fujimoto The Cryptonomist
Jun 20, 2025 North Korea’s BlueNoroff used AI-generated replicas of company executives in a Zoom call to trick a Web3 worker into downloading a malicious Zoom extension that installed malware on a macOS system. The attack began through a Telegram message that redirected the victim to a fake Zoom site. The malware included keyloggers, information stealers, and remote access tools. Employee at a cryptocurrency foundation Video Audio Digital Watch Observatory
Jun 20, 2025 An AI-generated image falsely claimed to show a downed Israeli F-35 jet in Iran. The image, circulated online after Iranian state media claims, contained AI-generated distortions, mismatched symbols, and scale inconsistencies. The aircraft's markings did not match those used on actual Israeli F-35s, and people near the aircraft appeared the same size as buses. Israeli government/military Image Digital Watch Observatory
Jun 20, 2025 An AI-generated image falsely claimed to show a downed Israeli F-35 fighter jet after Iranian state media reported shooting down two Israeli jets. The image contained visual inconsistencies typical of AI-generated content and did not match actual F-35 photos. Israeli F-35 fighter jets Image Yahoo
Jun 20, 2025 A falsified news story was made to appear as if it was published on SanAngeloLIVE.com. The fabricated article references a real incident—a shooting that occurred Wednesday, June 18, 2025, involving a sheriff’s deputy and a subject at a residence in Buffalo Heights. San Angelo LIVE! is pursuing legal action against the individuals responsible. San Angelo LIVE! Image sanangelolive.com
Jun 20, 2025 An AI-generated image depicting missiles falling on Tel Aviv circulated on social media in June 2025. The image was created by an AI artist and spread widely, causing confusion. The image was debunked by OSINT and disinformation experts who pointed out inconsistencies and the creator's watermark. Tel Aviv Image Snopes.com
Jun 19, 2025 Google is training AI models like Gemini and Veo 3 on YouTube videos. Veo 3 created videos very similar to existing YouTube content of creator Brodie Moss, with a score of 71 for the video and over 90 for just the audio. Creators feel their work is being used unfairly, without credit, consent, or payment. Brodie Moss, YouTube Creators Video Audio TipRanks
Jun 19, 2025 A deepfake video was created portraying Peter Obi praising Ibrahim Traoré. The video was created using AI-generated speech overlaid on existing video footage of Peter Obi. The audio did not match Peter Obi's known speech patterns, featuring a forced foreign accent. The speaker's mouth movements were unnaturally blurred and poorly synchronized with the audio. Peter Obi Video Audio Dubawa
Jun 19, 2025 AI-generated news reports falsely claimed Aurora Cannabis was acquiring MedLeaf Therapeutics for $215 million and forming a partnership with MediPharm GmbH. These reports quoted the CEO and cited SEC filings, leading to a drop in Aurora's stock price. Aurora Cannabis has denied these reports and stated they are taking the situation seriously. Aurora Cannabis Yahoo
Jun 19, 2025 North Korean BlueNoroff gang used deepfake Zoom calls to target tech company employees. Hackers sent Telegram messages with deceptive links leading to a fake Zoom domain. This resulted in the installation of malicious binaries, including crypto info stealers and surveillance programs, on victims' MacBooks. Tech company employees using MacBooks Video HotHardware
Jun 19, 2025 An AI-generated video was created showing a fake protest in Israel. The video depicted people carrying Israeli flags and placards, chanting for Pakistan to help stop attacks by Iran. Analysis confirmed the video was AI-generated due to anomalies in the footage, high tamper scores, and detection by AI content detection platforms. Israel Video Geo News
Jun 19, 2025 AI-generated video shows a fake protest in Israel asking Pakistan for help amidst the Israel-Iran conflict. The video was analyzed using AI content detection platforms (Attestiv and Hive Moderation), which confirmed the high likelihood of it being AI-generated due to tampering and visible anomalies like overly smooth faces. No US or Israeli news outlets reported any such protest. Israel Video Geo News
Jun 19, 2025 North Korea-aligned BlueNoroff used deepfake Zoom calls of company executives to trick a Web3 employee into installing malware on their macOS device. The employee was contacted via Telegram and a Calendly link which redirected to a fake Zoom domain. During the Zoom call, deepfakes of senior leadership urged the employee to install a malicious Zoom extension due to microphone issues, leading to the installation of malware. Web3 employee Video The Hacker News
Jun 19, 2025 A customer attempted to use an AI-edited image to fraudulently claim a refund from a Tsim Sha Tsui izakaya for a Keeta takeaway order. The customer claimed to have received the wrong order and submitted a manipulated photo as proof. The restaurant owner identified inconsistencies in the photo, leading to the rejection of the refund request. TST Izakaya Image Dimsum Daily
Jun 19, 2025 A netizen was scammed by a friend using ChatGPT to manipulate bank transaction screenshots to appear as if payments were made. The victim only discovered the scam after auditing her account and realizing none of the transactions had gone through. The perpetrator defrauded other classmates using the same method. Netizen and other classmates Image Inquirer.net
Jun 19, 2025 A deepfake video was created depicting President Anura Kumara Dissanayake endorsing a fraudulent investment scheme promising high returns. The voice in the video doesn't match the President's actual voice and the registration link leads to a fake Daily Mirror article featuring a fabricated interview. The Presidential Media Division confirmed the video was AI-generated. President Anura Kumara Dissanayake and Sri Lankan citizens Video Audio Fact Crescendo Sri Lanka
Jun 19, 2025 An AI-generated image of Vijay Mallya and Supriya Shrinate sitting together was circulated on social media. AI detection tools confirmed the image was likely AI-generated due to inconsistencies in facial structure. Supriya Shrinate and Vijay Mallya Image Vishvas News
Jun 19, 2025 An AI-generated image of Vijay Mallya and Supriya Shrinate went viral on social media. The image was found to be AI-generated with a 99% probability by multiple AI image detection tools due to inconsistencies in Shrinate's facial structure. Supriya Shrinate and Vijay Mallya Image Vishvas News
Jun 19, 2025 Joy Timeline HK Limited used AI to generate fake nude images of people without their consent via the CrushAI app. They advertised the app on Facebook and Instagram using at least 170 business accounts. The ads included AI-generated nude or sexually explicit images with captions such as upload a photo to strip for a minute and erase any clothes on girls. Users of Meta platforms (Facebook and Instagram) Image Hong Kong Free Press
Jun 19, 2025 Meta is suing Joy Timeline HK Limited, the company behind the CrushAI app, which uses AI to create fake nude images of people without their consent. Joy Timeline HK Limited allegedly violated Meta’s rules by running CrushAI ads with at least 170 business accounts it created on Meta-owned Facebook and Instagram. Some of the ads included AI-generated nude or sexually explicit images with captions such as “upload a photo to strip for a minute” and “erase any clothes on girls,” Individuals whose images were used in the CrushAI app Image Hong Kong Free Press
Jun 19, 2025 AI-generated videos falsely depicting the aftermath of the Air India plane crash were circulated on Facebook. The videos were flagged as likely AI-generated by detection tools, and reverse image searches did not find corroborating reports from reliable media outlets. General Public Video Rappler
Jun 19, 2025 A Latin American fintech company detected over 30 percent more fraud attempts, including injection attacks and deepfakes, by using Jumio's new Liveness Premium solution. The attacks utilized AI-generated faces, synthetic overlays and injection techniques. Latin American fintech company Fintech Singapore
Jun 19, 2025 A man was arrested for uploading an AI-generated doctored video of Odisha Chief Minister Mohan Majhi on Facebook, allegedly depicting the Chief Minister in an obscene manner. The video was created with the intention of defaming the CM. Mohan Majhi, Chief Minister of Odisha Video Asia News Network
Jun 18, 2025 North Korean BlueNoroff group deepfaked company executives in a Zoom call to trick an employee into installing macOS malware. The attackers contacted the target on Telegram, posed as professionals, and used a fake Zoom domain. The deepfake videos featured recognizable senior leadership to add credibility. The victim was tricked into downloading a malicious Zoom extension that installed malware, leading to cryptocurrency theft. Employee at a tech firm Video BleepingComputer
Jun 18, 2025 Attackers posed as virtual legal assistants requesting account closures on behalf of customers using voice modulation. major U.S. retailer Audio KnowBe4 blog
Jun 18, 2025 Disney and NBCUniversal are suing Midjourney for copyright infringement, alleging that the AI image generation tool allows users to create near-perfect copies of their characters (e.g., Darth Vader, Minions). They argue this infringes on their IP and could lead to lost revenue and brand damage if AI-generated images are distributed widely. Disney and NBCUniversal Image IndieWire
Jun 18, 2025 YouTuber Cr1TiKaL fooled his viewers with an AI-generated intro to his video to demonstrate the advancements in AI video generation. The intro included AI-generated script, visuals, and voice, created by a Reddit user. Cr1TiKaL cropped out the watermark and zoomed in to hide the hands, which are a common giveaway for AI-generated content. Cr1TiKaL's viewers Video PetaPixel
Jun 18, 2025 A scammer is impersonating the voice of WCPO 9 meteorologist Jennifer Ketchmark using AI software in Facebook messages to solicit money. The fake account is making friend requests and uses voice impersonation to sound like Jennifer. An example message is provided to illustrate the scam. Jennifer Ketchmark and Facebook users Audio WCPO 9 Cincinnati
Jun 18, 2025 A LATAM finance startup using Jumio Liveness Premium caught over 30% more sophisticated fraud attempts including injection attacks and deepfakes. LATAM finance startup Help Net Security
Jun 18, 2025 Epic Games utilized AI for Star Wars' Darth Vader in Fortnite, allowing players to talk to the character and having him respond in the voice of the late James Earl Jones. SAG-AFTRA filed an unfair labor practice charge against Epic Games, insisting that Epic Games had decided to use AI "without providing notice to the union or the opportunity to bargain." James Earl Jones / Darth Vader Audio Bounding Into Comics
Jun 18, 2025 AI generated images that are more severe than images that were actually taken in reality. The victim was a real child sex abuse victim whose images had been circulating since 2011. Although her abuser was caught, and the girl eventually "went public" with her story, the images had been shared widely. A real child sex abuse victim Image BBC
Jun 18, 2025 AI-generated images of a known child abuse victim are being created, some of which are even more severe than the original abuse images. These images are circulating online alongside real images of child abuse, making it difficult to differentiate and potentially leading law enforcement to chase non-existent victims or miss real cases. A victim of child abuse whose images had been circulating since 2011 Image BBC
Jun 18, 2025 AI-generated images, some more severe than the original abuse images, are circulating. The IWF first saw AI images in 2023, but reports quadrupled in 2024. Real child sex abuse victim (Natalia) Image BBC
Jun 18, 2025 Fraudulent streams of AI-generated music on Deezer, inflated by bots to collect royalty payments. Up to 70% of AI-generated music streams are fraudulent, with AI music accounting for 0.5% of streams. A specific case involves Michael Smith generating hundreds of thousands of AI songs and streaming them billions of times, obtaining $10 million in royalties. Legitimate artists and Deezer Audio The Guardian
Jun 17, 2025 AI-generated nude images were created using the faces of dozens of girls from Western Dubuque School District and other area schools. The photos were created by male students at Cascade High School. An investigation is underway by the Cascade Police Department and the Dubuque County Sheriff's Office. Female students at Western Dubuque School District and other area schools Image KWWL
Jun 17, 2025 A deepfake video surfaced online appearing to show Zoey Stark announcing her retirement from WWE, which caused concern among fans and her family. Stark later confirmed the video was AI-generated and that she is not retiring. Zoey Stark Video Wrestling Inc.
Jun 17, 2025 Police are warning about a rise in AI-generated deepfakes being used as a form of cyberbullying and harassment in schools. Nude images of children are being created and circulated. Approximately 4,000 sexually explicit deepfake images and videos of children and youth were generated last year. One in 10 youth say they know of cases where their friends and classmates have created “deepfake nudes” of other kids using AI-generated tools. Children and youth in Alberta schools Image Video Audio Edmonton Journal
Jun 17, 2025 AI-generated nude images and other forms of cyberbullying and harassment are targeting children and youth in schools. These deepfakes are being used to victimize children and youth, potentially leading to extortion. 4,000 sexually explicit deepfake images and videos of children and youth were generated last year. Children and youth in Alberta schools Image Video Audio Edmonton Journal
Jun 17, 2025 Users posted a fake news segment in multiple languages, including an anchor announcing the death of author J.K. Rowling. The article also mentions the potential for harassment using the technology. J.K. Rowling Video The Week
Jun 17, 2025 Users posted fake news segments in multiple languages, including an anchor announcing the death of author J.K. Rowling. (She is not dead.) J.K. Rowling Video The Week
Jun 17, 2025 AI reanimations/deepfakes are used to make facsimiles of the dead. Christopher Pelkey's AI video reconstruction delivered a victim impact statement at the sentencing hearing of his killer. Dead Israeli singers were to be conjured using AI-generated sound and video for a concert. A deepfake version of Agatha Christie was created to teach a writing course. Christopher Pelkey, Iconic Israeli Singers, Agatha Christie Video Audio The Conversation
Jun 17, 2025 Senator Ronald 'Bato' dela Rosa shared an AI-generated video featuring supposed students questioning the impeachment process against Vice President Sara Duterte. The video questioned why Duterte is being singled out. House prosecution panel spokesperson Antonio Audie Bucoy criticized Dela Rosa, stating that sharing a fake source propagates a lie and emphasizes bias. Sara Duterte Video GMA Network
Jun 17, 2025 AI-generated videos were falsely shared claiming they showed damage to Tel Aviv and Ben Gurion International Airport after Iran struck Israel with missiles. The videos were originally posted by a TikTok account that creates AI content. One video showed a heavily damaged airport, and another showed damaged buildings. Tel Aviv and Ben Gurion International Airport Video Yahoo
Jun 17, 2025 AI-generated images were circulated on Facebook and other social media platforms, falsely claiming that Iran had shot down a U.S. Air Force B-2 Spirit strategic bomber. The images showed inconsistencies, such as the bomber's size being disproportionate to people nearby, indicating they were created using AI. U.S. Air Force, general public Image მითების დეტექტორი
Jun 17, 2025 A fabricated TikTok story depicted a nonexistent Kansas City electrician and basketball coach, Andre Tillman, being arrested. The story, amplified by AI, garnered millions of views and spawned fraudulent GoFundMe campaigns before being debunked by police and removed from the platform. Andre Tillman's Fictional Persona KMBC
Jun 16, 2025 Timbaland allegedly used KFresh's beat without permission to create an AI-generated beat using Suno's AI, featuring an artist named C-Red rapping over it. Timbaland then created another version using his "Baby Timbo" AI. KFresh claims Timbaland never reached out to him for permission. KFresh Audio Digital Music News
Jun 16, 2025 AI-generated videos falsely using his likeness to promote miracle cures and wonder drugs. Tom Hanks Video Quartz
Jun 16, 2025 CrushAI used generative AI to create deepfake nudes from uploaded photos, which were then advertised on Instagram and Facebook. Meta is suing Joy Timeline HK Limited, the company behind CrushAI, for violating its terms of service and circumventing enforcement. Users of Facebook and Instagram, specifically in the U.S., UK, Canada, Germany, and Australia, with a focus on women. Image CEO Today
Jun 16, 2025 A video surfaced depicting students defending Sara Duterte and opposing her impeachment. The video was determined to be AI-generated using Google's Veo, as indicated by the watermark. Deepware also flagged it as suspicious. The video was shared by a senator before it was identified as AI generated. Sara Duterte Video Rappler
Jun 14, 2025 Disney and Universal filed a lawsuit against Midjourney for copyright infringement, alleging that Midjourney trained its AI on copyrighted images and enabled users to generate unauthorized reproductions of characters like Darth Vader and Homer Simpson. Getty Images also has a lawsuit against Stability AI for scraping millions of its copyrighted photos to train Stable Diffusion. Disney, Universal, Getty Images Image Forbes
Jun 14, 2025 A YouTube user created an AI-generated version of Ed Sheeran's song 'Sapphire' sung entirely by Arijit Singh, accompanied by an AI-generated image of both artists. Arijit Singh previously won a case against the misuse of his voice by AI platforms. Arijit Singh, Ed Sheeran Audio Image Mint
Jun 14, 2025 A Hong Kong finance worker transferred $25 million to fraudsters after a video conference where every participant was a deepfake of company staff. Hong Kong finance worker's company Video Tech Times
Jun 14, 2025 Pornographic videos with the faces of female celebrities superimposed on other bodies were posted on Reddit in 2017. Female Celebrities Image Video The Regulatory Review
Jun 13, 2025 Stephen King posted an AI-generated image depicting Donald Trump as a taco on social media, using Elon Musk's Grok AI. The image is part of a trolling campaign referencing Trump's policy flip-flops. Donald Trump Image Indy100
Jun 12, 2025 Meta is taking legal action against Joy Timeline HK Limited, the company behind the "CrushAI" app, which allows users to create AI-generated nude or sexually explicit images of individuals without their consent. The company attempted to circumvent Meta's ad review process after repeated removals of their ads for violating Meta's policies. Individuals depicted in AI-generated nude or sexually explicit images created by the CrushAI app Image Social Media Today
Jun 12, 2025 A student created an AI-generated nude image of a female student and shared it with other students at school. The victim was notified of the image's existence at school. The creator admitted to making the image and shared the website used. The school district did not discipline the student, leading the victim's mother to speak out. Hingham Middle School student Image Boston.com
Jun 12, 2025 Meta is suing Joy Timeline HK Limited, the developer of Crush AI, an app that generates fake naked imagery. Hundreds of ads for similar apps were found on Meta platforms. An AI-generated video of Brazilian soccer player Ronaldo Nazário endorsing an online game was also found. Apple also removed generative AI apps that created nude images. Individuals whose images are used in 'nudify' apps, Brazilian soccer player Ronaldo Nazário Image Video PCMag
Jun 12, 2025 Meta is suing Joy Timeline HK Limited, the creator of the 'nudify' app CrushAI, which allows users to create sexually explicit images of people using AI. The lawsuit alleges the company circumvented Meta's ad review process to promote the app on Facebook and Instagram. Senator Dick Durbin cited a report estimating that 90% of CrushAI's traffic came from Meta's platforms. People whose images are used in the CrushAI app Image Investopedia
Jun 12, 2025 Meta is suing Joy Timeline HK for advertising 'nudify apps' like CrushAI that create AI-generated nude images without consent. Joy Timeline HK allegedly tried to circumvent Meta's ad review processes after violating its rules. The apps are used to create non-consensual sexual imagery used for sextortion, blackmail, and abuse. Individuals whose images are used to create deepfake nudes Image Mint
Jun 12, 2025 Meta is suing CrushAI for advertising a deepfake app that creates sexually explicit deepfakes by circumventing Meta's rules. The ads targeted users in the US, Canada, Australia, Germany, and the UK, and some featured AI-generated nude images. Meta (Facebook and Instagram users) Image CNN
Jun 12, 2025 Joy Timeline HK Ltd. allegedly promoted "nudify" apps (CrushAI) that use AI to strip clothes from images and generate fake nude content without consent. The apps were promoted on Facebook and Instagram before Meta removed them. Meta states these tools are fueling sextortion, blackmail, and digital abuse. Individuals whose images were used to create fake nudes Image Yahoo Finance
Jun 12, 2025 Meta is suing the maker of the CrushAI app for creating and advertising sexually explicit deepfakes. The app allows users to create nude or sexualized images from a photo of someone’s face. The ads circumvented Meta’s rules and targeted users in multiple countries with phrases like 'upload a photo to strip for a minute' and 'erase any clothes on girls.' Users of Meta Platforms (Facebook and Instagram) particularly in the United States, Canada, Australia, Germany and the United Kingdom, and potentially celebrities and high school girls Image WCVB
Jun 11, 2025 Disney and Universal are suing Midjourney for copyright infringement, claiming the AI image generator creates unauthorized copies of their copyrighted characters and trains its video service on copyrighted materials. The lawsuit includes Midjourney-generated images of characters like Darth Vader, Minions, Shrek, and Yoda. Disney, Universal, and the hard-working creative community Image Video PC Gamer
Jun 11, 2025 Disney and NBCUniversal have filed a lawsuit against Midjourney for copyright infringement. Midjourney allows users to generate images of copyrighted characters, which the studios claim is a violation of their copyright. Midjourney trained its AI model using copyrighted content downloaded from the Internet. Disney, NBCUniversal, and their copyrighted characters (Darth Vader, Shrek, Yoda, Wall-E, Stormtroopers, Minions, characters from How to Train Your Dragon) Image Ars Technica
Jun 11, 2025 Disney and Universal are suing Midjourney, an AI image generator, for copyright infringement. They allege that Midjourney allows users to recreate their copyrighted characters (e.g., from Marvel, Star Wars, Shrek) without proper licensing, using AI image generation technology. The lawsuit includes examples of generated images featuring iconic characters. Disney and Universal Image CNET
Jun 11, 2025 Disney and Universal Studios are suing Midjourney for copyright infringement, alleging that the AI image generator used their copyrighted material to train its AI and generate unauthorized reproductions of characters like Darth Vader, Elsa, Minions, Shrek and Homer Simpson. The studios claim Midjourney profited from their work and seek damages and an injunction to stop the distribution of infringing images. Disney and Universal Studios Image PetaPixel
Jun 11, 2025 Disney and Universal are suing Midjourney for copyright infringement due to the AI image generator creating images of characters from their movies and TV shows without permission. The studios claim Midjourney ignored requests to stop and is profiting from the unlicensed use of their intellectual property. Disney and Universal Image NBC News
Jun 11, 2025 Deepfake images of Aespa's Karina were used in a teaser for the Seoul Waterbomb 2025 festival without her consent. Fans expressed outrage, criticizing the festival organizers and Karina's management (SM) for allowing the use of AI and deepfake technology. SM had previously condemned the use of AI and deepfakes for their artists. Aespa Karina Image Times of India
Jun 11, 2025 Disney and Universal are suing Midjourney for copyright infringement, claiming the AI image generator created unauthorized copies of their characters like Darth Vader and Elsa. The lawsuit alleges that Midjourney used the studios' copyrighted works to train its AI image service and generate reproductions without permission. Walt Disney, Universal Image Reuters
Jun 11, 2025 Disney and Universal sued Midjourney for copyright infringement, alleging that the AI image generator is a "bottomless pit of plagiarism." They claim Midjourney pirated their libraries and made unauthorized copies of characters like Darth Vader, Elsa, and the Minions. The studios provided examples of Midjourney animations featuring Disney characters, such as Yoda wielding a lightsaber and Buzz Lightyear taking flight, and Universal characters such as Toothless, Shrek, and Po from Kung Fu Panda. Disney and Universal Image The Guardian
Jun 11, 2025 Disney and Universal sued Midjourney for copyright infringement, claiming the AI tool creates unauthorized copies of their characters like Chewbacca and Spider-Man based on prompts. The lawsuit includes examples of Midjourney-generated images alongside original source material to demonstrate the similarities. Disney and Universal Image Business Insider
Jun 10, 2025 Report details AI-generated deepfake impersonations, social engineering schemes, and Ponzi-style frauds. Deepfakes simulate text, voice messages, facial expressions and even actions. Fake video endorsements of investment platforms from public figures such as Singapore’s prime minister and Elon Musk are tactics used to exploit public trust via Telegram, X and other social media platforms. Sandeep Nailwal was impersonated via Zoom. Public figures, platform executives, Sandeep Nailwal, Elon Musk, Singapore’s prime minister Video Audio Image Cointelegraph
Jun 10, 2025 The article discusses Florida's new laws against deepfake pornography and other sexual offenses against children. It mentions Brooke Curry, whose image was used to create a fake image, and mentions other celebrities and women politicians have been targets of deepfake sexual imagery. Brooke Curry, Taylor Swift, Jenna Ortega, Megan Thee Stallion, women politicians Image Tallahassee Democrat
Jun 07, 2025 Lawyers cited fake cases generated by AI in court proceedings in England. In one case, a lawyer cited 18 cases that did not exist in a \u00a390 million lawsuit. In another, a lawyer cited five fake cases in a tenant’s housing claim. UK Justice System AP News
Jun 06, 2025 Meta's platforms (Facebook, Instagram, etc.) displayed ads for 'nudify' apps that create sexually explicit deepfakes from uploaded images. The ads targeted men aged 18-65 and were active in the US, EU, and UK. Some ads used deepfake images of celebrities. The apps sometimes required payment to access 'exclusive' features. The generated content often bypassed age verification measures. These apps were available on Meta platforms and sometimes even Apple's app store. Individuals whose images were used to create 'nudify' deepfakes, including celebrities like Scarlett Johansson and Anne Hathaway. Also, potentially minors if age verification is not in place. Image CBS News
Jun 05, 2025 Senator Natasha Akpoti-Uduaghan claims a viral audio recording circulating on social media is a deepfake and not her voice. She alleges her communications may have been accessed to clone her voice and make fraudulent calls. She has involved her legal and security teams to investigate the matter. Senator Natasha Akpoti-Uduaghan Audio TV360 Nigeria
Jun 05, 2025 Deepfake videos of Finance Minister Nirmala Sitharaman and Google CEO Sundar Pichai promoting fraudulent investment schemes led to investors losing money. Scammers are using AI to create hyper-realistic videos that impersonate public figures to trick victims into sending money or sharing sensitive data. Brand abuse accounts for nearly one-third of all cybercrime incidents in India, with banking, retail, and government sectors bearing the brunt. Nirmala Sitharaman, Sundar Pichai, Indian investors Video The Logical Indian
Jun 05, 2025 AI-generated images falsely depicting Rekha in a hospital bed after a heart attack were circulated on social media. The images showed Amitabh Bachchan and Jaya Bachchan visiting her. AI-detection tools identified inconsistencies and distortions indicative of AI generation. Rekha Image News Mobile
Jun 05, 2025 AI-generated images circulating on social media falsely claim that actress Rekha was hospitalized after a heart attack. The images show Amitabh Bachchan and Jaya Bachchan visiting her in the hospital. The images exhibit tell-tale signs of AI generation such as unnatural facial expressions, blurred textures, distorted features, and inconsistent lighting. Rekha Image News Mobile
Jun 05, 2025 A viral audio and video clip allegedly featured Natasha Akpoti-Uduaghan accusing Senate President Godswill Akpabio of blackmailing President Bola Tinubu to orchestrate her imprisonment. She claims the voice in the video is not hers and has been cloned and manipulated. Natasha Akpoti-Uduaghan Audio Video TheCable
Jun 05, 2025 New Zealand MP Laura McLeod McClure showed an AI-generated nude image of herself in Parliament to highlight the dangers of deepfake technology and advocate for stricter laws. The image was created using AI and took less than five minutes to make. Laura McLeod McClure Image India TV News
Jun 05, 2025 New Zealand MP Laura McLeod McClure created an AI-generated nude image of herself to demonstrate the ease with which deepfakes can be created and used to harm individuals, particularly women. She used this image to advocate for stricter laws against deepfake abuse during a parliamentary session, introducing the Deepfake Digital Harm and Exploitation Bill. Laura McLeod McClure Image India TV News
Jun 05, 2025 New Zealand MP Laura McClure displayed an AI-generated nude image of herself in Parliament to highlight the dangers of deepfake technology. The image was created online in less than five minutes. McClure is advocating for amending legislation to address the harm caused by deepfakes. Laura McClure, New Zealand MP Image News18
Jun 05, 2025 New Zealand MP Laura McClure displayed an AI-generated nude image of herself in Parliament to highlight the dangers of deepfake technology. The image was created in less than five minutes. Laura McClure Image News18
Jun 05, 2025 New Zealand MP Laura McClure displayed an AI-generated nude image of herself in Parliament to highlight the dangers of deepfake technology. She stated it took less than 5 minutes to create. She is advocating for changes in legislation related to sharing nude photographs without consent to include deepfakes. Laura McClure, New Zealand MP Image News18
Jun 05, 2025 New Zealand MP Laura McClure displayed an AI-generated nude image of herself during a parliamentary session to highlight the threat of deepfake technology. The image, the MP said was created in under five minutes using readily available online tools and was displayed in parliament to urge legal reform. McClure shared the image on her Instagram account. Laura McClure, New Zealand MP Image The New Indian Express
Jun 05, 2025 A video circulating on social media falsely claims that former US President Donald Trump called Ukrainian President Volodymyr Zelenskyy a 'total cokehead' during a press conference. Fact-checkers have debunked this claim, identifying the video as a deepfake. The original footage was from a White House press conference on May 12, 2025, where Trump did not make the alleged remarks about Zelenskyy. Volodymyr Zelenskyy Video aapnews.aap.com.au
Jun 04, 2025 AI-generated fake advertisements for herbal remedies and other products are circulating on digital platforms in Nigeria, misleading consumers with false claims and AI-generated testimonials. One case involved an advertisement for an herbal remedy claiming to cure over 200 diseases. Nigerian consumers Broadcast Media Africa
Jun 04, 2025 A paraglider named Peng Yujiang allegedly used AI-generated footage in a viral video claiming he was sucked into a storm. Analysis suggests the first five seconds of the video were likely AI-generated, with inconsistencies in the video, a Doubao AI watermark, and distortions in the footage, raising doubts about the authenticity of his story. Public Perception of Peng Yujiang Video Global News
Jun 04, 2025 Michael B. Erickson, a student at Northern Illinois University, was charged with multiple counts of child pornography after allegedly creating thousands of AI-generated images depicting underage victims in nude or sexual situations. He reportedly uploaded photos of victims to Telegram and used AI to remove their clothing. He also allegedly sold the photos to others. Multiple underage victims Image FOX 32 Chicago
Jun 04, 2025 Gizmodo writer used Captions' Mirage Studio to create a video using Gizmodo content. The AI tool used a video from Gizmodo's Instagram page, selected an "actor," and generated a new video with visual distortions and hallucinations. Kyle Barr/Gizmodo Video Gizmodo
Jun 04, 2025 An AI company used Kyle Barr's content from Gizmodo to create a deepfake video using their video generation model, Mirage Studio. The video used Barr's audio and a reference image to create an AI-generated video with visual distortions. Kyle Barr Video Gizmodo
Jun 04, 2025 An image was posted on Facebook purporting to show workers assembling electronic devices in Burkina Faso. The image was determined to be AI-generated due to flaws like nonsensical text, unnatural positioning of workers, and inconsistencies in the image. An AI detection tool confirmed a high probability of AI generation. The image was previously debunked when falsely attributed to Zambia. Burkina Faso Image PesaCheck
Jun 04, 2025 A Facebook page called '90's History' is generating AI pictures of Holocaust victims using their real names and stories taken from the Auschwitz Museum's posts. The museum has asked them to stop because it undermines the integrity of history and presents fictionalized performances as remembrance. The page copies real content but swaps real photos for AI-generated versions, misleading viewers. They never mention that the content is fake, while presenting themselves as a legitimate history page. Holocaust victims and the Auschwitz Museum Image PetaPixel
Jun 04, 2025 Benjamin Michael Jomaa is accused of sextorting three women by threatening to distribute AI-manipulated images of them online if they did not send him more intimate pictures or participate in a sexual act. He was arrested after police searched his home and seized electronic devices. Three women in their 20s Image Yahoo
Jun 04, 2025 A deepfake video using Anne Curtis' image was circulated on social media to promote a fake 'financial project'. Viva Artists Agency confirmed that Anne Curtis is not connected to the Facebook page promoting the project and that the video was made without her consent. Anne Curtis Video Inquirer.net
Jun 04, 2025 A 13-year-old male student used AI to undress photos of two female classmates taken from Instagram. These images were then shared on Snapchat. In a separate event, Elliston Berry, at age 14, had a fully clothed photo of herself manipulated using an AI-undressing app by a classmate and distributed to 2,400 students. Two 13-year-old girls in Fox Point, Wisconsin, and Elliston Berry Image FOX6 News Milwaukee
Jun 03, 2025 AI-generated voice messages claiming missed federal jury duty were used to scam residents. The calls directed individuals to contact a phone number and visit a website to extract money via bitcoin or prepaid cards. Over 800 calls were received by the Sheriff's Office. Lancaster County residents Audio KHGI
Jun 03, 2025 A robocall featuring the voice of President Joe Biden told residents to stay home and save their votes for the November general election. New Hampshire voters Audio The Center Square
Jun 03, 2025 Volkswagen used generative AI to create a deepfake version of the late Brazilian singer Elis Regina for an advertisement, stirring controversy around matters of consent. Elis Regina (deceased) Video ZDNET
Jun 03, 2025 A paragliding accident video involving Peng Yujian, posted on Douyin, is suspected to be partly AI-generated. The first five seconds of the video are believed to contain AI-generated images, with inconsistencies such as strange changes to the paraglider’s helmet and equipment. Several media outlets have removed the video. Peng Yujian Video Gizmodo
Jun 03, 2025 Fortnite used AI-generated voice technology to mimic the voice of a well-known villain NPC. This raises concerns about name, image, and likeness (NIL) rights, specifically concerning AI-recreated voices. The core issue revolves around whether AI-generated voices, built from past performances, are protected under existing NIL frameworks. Voice actor/estate Audio Mondaq
Jun 03, 2025 A deepfake video was created using AI to mimic Joe Bonamassa's voice and image. The video was designed to deceive fans and potentially scam them. The AI-generated voice was used to make Bonamassa say he loved a fan named Lizzie. The video used existing footage of Bonamassa from 2021 with the AI-generated voice dubbed over it. Joe Bonamassa and his fans Video Audio GuitarPlayer.com
Jun 03, 2025 A deepfake video was created using AI to mimic Joe Bonamassa's voice and likeness. The video was designed to deceive fans and potentially scam them. The AI-generated voice was used to make it appear as though Bonamassa was creating a personalized video for a fan named 'Lizzie,' expressing affection and telling a story, likely with the intention of exploiting the relationship for financial gain or other malicious purposes. Joe Bonamassa fans; Joe Bonamassa Video Audio GuitarPlayer.com
Jun 03, 2025 Scammers created a deepfake video of Joe Bonamassa using AI to generate a voice and altered video clip to mislead and scam fans. The deepfake depicts Bonamassa declaring love to someone named 'Lizzie'. Bonamassa has confirmed this to be a fake. Joe Bonamassa's fans Video Audio GuitarPlayer.com
Jun 02, 2025 A New Zealand MP held up a naked deepfake photo of herself in Parliament. New Zealand MP Image The Independent
Jun 02, 2025 A deepfake video used stolen footage and AI-generated voices of Wyoming News Now journalists to promote a fake company, Bunkers4Everyone, claiming to build bunkers in Yellowstone National Park. The deepfake also included a fake website, press release, and LinkedIn bio. Wyoming News Now journalists (specifically Ashley Morgan), Yellowstone National Park Video Audio GearJunkie
Jun 02, 2025 In 2019, a UK-based energy company CEO's voice was cloned and used to trick an executive into transferring €220,000 to a fake Hungarian supplier account. UK-based energy company CEO Audio HackerNoon
Jun 02, 2025 A New Zealand MP, Laura McClure, held up a deepfake naked photo of herself in Parliament to highlight the dangers of deepfake technology. The image was created online in less than five minutes. Laura McClure, MP Image AOL.com
Jun 02, 2025 A New Zealand MP, Laura McClure, held up a generated naked image of herself in parliament to show the dangers of deepfake technology. The image was created quickly online. She stated the image was not real. Laura McClure Image The Independent
Jun 02, 2025 San Francisco's city attorney filed a lawsuit against website owners operating sites using AI-generated non-consensual explicit images of adults and minors. Ten of sixteen websites were shut down for violating state and federal laws. One defendant, Briver, settled with a permanent injunction and a $100,000 penalty. The websites attracted 200 million visitors in the first 6 months of 2024. Adults and Minors (victims of deepfake pornography) Image ABC7 San Francisco
Jun 02, 2025 AI-generated images were used in a Facebook post to falsely claim that a large sinkhole containing Norse artifacts had opened up at Red Clay State Historic Park. The images depicted park rangers in incorrect uniforms and the post was attributed to a satirical 'Cleveland Tennessee Breaking News' page. The park manager confirmed the information was false. Red Clay State Historic Park Image Local 3 News
Jun 01, 2025 A deepfake video purporting to be set leaks from 'Avengers: Doomsday' spread on social media. The video contained fabricated scenes with actors like Robert Downey Jr. as Doctor Doom and appearances by other characters. The video was debunked by the community but not before reaching millions of views. Marvel/Avengers Franchise Video Forbes
Jun 01, 2025 A woman in Argentina was scammed out of approximately Rs 11 lakh by someone impersonating George Clooney via deepfake videos on Facebook. The scammer convinced her to join a fan club and pay for a special card to unlock exclusive work opportunities. Woman in Argentina Video The Indian Express
May 31, 2025 Elijah Heacock received a threatening text message with an AI-generated nude photo of himself, demanding $3,000 to prevent its distribution to his friends and family. He died by suicide shortly after receiving the message. Elijah Heacock Image CBS News
May 30, 2025 Fresno Unified School District's communications office, under the direction of Superintendent Misty Her, created a dossier containing 39 fabricated quotes attributed to the Fresno Teachers Association (FTA) using AI. The dossier accused the FTA of personally attacking Superintendent Her. The fabricated quotes were found in news reports and emails. The communications chief, Nikki Henry, has been placed on leave following the incident. Fresno Teachers Association (FTA) GV Wire
May 30, 2025 A video purportedly showing a Chinese paraglider, Peng Yujiang, surviving an unplanned high-altitude ascent was widely circulated but later removed by news organizations like NBC, BBC, and CNN due to concerns it was AI-generated. The video was originally posted on Douyin and licensed by CCTV. Suspicion arose after a Doubao AI logo was cropped from the video. Peng Yujiang Video Deadline
May 30, 2025 A video emerged purportedly showing paraglider Peng Yujiang surviving a high-altitude ascent. News organizations pulled the video after concerns arose that it was AI-generated, potentially using Doubao AI. The video, initially shared on Douyin and distributed by CCTV, showed Peng battling winds and appearing frostbitten. NBC News identified AI-generated elements in the footage. Peng Yujiang Video Deadline
May 29, 2025 The Chicago Sun-Times published a summer edition containing a list of 15 books, 10 of which were falsely generated by an AI agent. This content, licensed from King Features, bypassed the Sun-Times' editorial review process due to multiple human errors. The incident resulted in embarrassment for the Sun-Times staff and triggered discussions about the use of AI in local news. Chicago Sun-Times readers Chicago Sun-Times
May 29, 2025 Jack Bullington was arrested for creating and distributing AI-generated sexually explicit images of minors. He allegedly cropped the faces of 11 victims from social media onto nude bodies and shared the images on X, including requesting alterations for payment from someone overseas. 11 juvenile females Image KEYE
May 28, 2025 A Vietnam-based hacking group (UNC6032) created fake AI-powered video generator websites and promoted them via malicious ads on social media. These websites distributed malware (STARKVEIL) that steals user credentials, cookies, credit card data, and Facebook information. The campaign ran from mid-2024, impacting users globally. The hackers used Facebook pages and compromised accounts to publish ads, reaching millions of users. The malicious domains were rotated to avoid detection. Users of social media platforms like Facebook and LinkedIn interested in AI video generation tools. Video The Record from Recorded Future News
May 28, 2025 Cybercriminals are using fake text-to-video tools promoted via ads and comments on Facebook and LinkedIn to deliver malware, including information stealers, Trojans, and backdoors. They promote fake tools like "Luma AI," "Canva Dream Lab," and "Kling AI" across 30+ websites imitating legitimate AI tools, rotating domains and creating new ads daily. The malware harvests data from infected devices and sends it to the cybercriminals. Facebook and LinkedIn users Video Malwarebytes
May 27, 2025 AI song generators are used to flood platforms with millions of fake songs, streaming each one a few thousand times to generate royalties. Michael Smith allegedly extracted over US$10 million by uploading hundreds of thousands of AI-generated songs and using bots. Music Industry, legitimate artists, labels, and publishers Audio World Intellectual Property Organization (WIPO)
May 27, 2025 In 2023 fraudsters tricked a finance employee at British engineering firm Arup into transferring $25 million into their accounts. The scammers used a deepfake video call featuring AI-generated avatars of the company's CFO and other executives, making the interaction appear real. Arup finance employee Video Bank Info Security
May 27, 2025 Gayanne Potter, a voiceover artist, is in a dispute with ScotRail and ReadSpeaker after an AI version of her voice, named "Iona," was implemented on Scotland's nationalized train network without her explicit consent. Potter alleges that ReadSpeaker used recordings from a previous job to create the AI voice, violating her rights and potentially infringing on her data protection. She feels exploited and claims the AI clone is demeaning to her career. ScotRail has rejected her concerns and has no plans to remove the AI voice system. This has led to a legal dispute, with Union Equity supporting Potter's case. Gayanne Potter Audio Sky News
May 26, 2025 A Karnataka lawyer was duped of ₹5.93 lakh after being lured by an AI-generated video of Donald Trump promoting a hotel investment scheme on YouTube. The 38-year-old advocate believed the video was real and joined a Telegram group linked in the video. He then invested his money, but when the returns never came and the group vanished, he realized he had been scammed. He had initially paid ₹1,500 to activate his account after submitting his bank details, and was promised a 3% daily return. Lured by early returns, he invested a total of ₹5,93,240 between January 25 and April 4. A case has been registered under the IT Act and Section 318(4) of the Bharatiya Nyaya Sanhita. Police have frozen ₹1.5 lakh in the recipient bank account. A Karnataka lawyer Video Hindustan Times
May 26, 2025 Cybercriminals used deepfake videos of Donald Trump to promote a fake investment scheme called "Trump Hotel Rentals" via YouTube and other social media platforms. The videos directed viewers to a fraudulent mobile app that claimed to offer high-yield returns from property rentals. Victims were lured in with small initial gains before being encouraged to invest larger sums, ultimately losing their money. Victims in India, Donald Trump's reputation Video The420.in
May 26, 2025 Hackers are posting AI-generated videos on TikTok to trick users into downloading infostealing malware. The videos demonstrate how to easily “activate” Windows and Microsoft Office, or enable “premium features” in apps such as Spotify or CapCut. The clips were AI-generated and trick the victims into downloading Vidar and StealC infostealers. One of the videos has roughly 500,000 views, more than 20,000 likes, and more than 100 comments. TikTok users Video TechRadar
May 26, 2025 Scammers are impersonating senior U.S. officials through AI-generated voice messages (vishing) since April 2025. They target high-ranking officials and their contacts to gain access to personal accounts. U.S. officials and their contacts Audio Asbury Park Press
May 26, 2025 An AI-generated image, created based on a police sketch related to a sexual assault investigation in the Saskatoon area, is circulating online. The RCMP warns that the AI image is inaccurate and misleading, as it does not match the descriptors provided by witnesses. The RCMP advises the public to focus on the original sketch released by their Forensic Artist instead. Saskatchewan RCMP sexual assault investigation Image WestCentralOnline
May 26, 2025 An AI-generated video, created by @mbaiarts on Instagram, falsely portrays scuba divers discovering a 5,000-year-old Sri Maha Vishnu temple in the sea off Bali, Indonesia. Hive app analysis indicates a 99% likelihood that the video is AI-generated. The video was shared widely on social media. Viewers/Social Media Users Video FACTLY
May 26, 2025 The band Ice Nine Kills used AI-generated images for promotional material, specifically a picture of Freddy Krueger and Jason Voorhees grilling meat and another image of the band members. This led to backlash from fans and a ban from being mentioned or promoted on the r/metalcore subreddit. Ice Nine Kills Image Louder
May 26, 2025 A deepfake video of Finance Minister Nirmala Sitharaman was created to promote a fraudulent investment platform promising passive income. The video was altered using AI to make it appear as though she was endorsing the platform. AI detection tools confirmed the video and audio were manipulated. Nirmala Sitharaman Video The Quint
May 26, 2025 Anthony Rotondo posted deepfake images of prominent Australian women to the MrDeepFakes website. The eSafety commissioner launched proceedings against Rotondo for failing to remove the images. Rotondo was fined for contempt of court in December 2023 for breaching court orders by not removing the imagery. Prominent Australian women (names kept confidential) Image The Guardian
May 25, 2025 The content describes a North Texas teen who was the victim of deepfake revenge porn, leading to a new federal law cracking down on such images. North Texas teen Image CBS News
May 24, 2025 50 Cent has been posting AI-generated images and videos mocking Diddy during his trial. These include images of 50 Cent on the jury, Diddy in a pool of baby oil, Diddy in jail, Diddy riding with Jeffrey Epstein, and 50 Cent wearing a 'Free Diddy' shirt. Diddy Image Video Daily Mail
May 24, 2025 50 Cent used AI to alter a photo of Lil Kim that he didn't like and posted the result on Instagram. He claimed that even AI couldn't fix the photo to his liking. Lil Kim Image Complex
May 23, 2025 SAG-AFTRA filed an unfair labor practice charge against Llama Productions (Epic Games subsidiary) for using AI to generate the voice of Darth Vader in Fortnite without negotiating with the union. The union claims this replaces the work of human performers and violates their bargaining agreement. SAG-AFTRA Audio ComicsBeat
May 23, 2025 Google's Veo 3 AI video synthesis model was tested by creating a deepfake video of Will Smith eating spaghetti. The AI-generated video included synchronized audio, but the spaghetti eating sound effect had a 'crunching' glitch. Will Smith Video Audio Ars Technica
May 23, 2025 A 36-minute YouTube video presented as a speech from Pope Leo XIV to Burkina Faso’s President Ibrahim Traoré, which was confirmed by the Vatican Press Office and Vatican News to be a deepfake. AI lip-sync technology was used to make the video appear real. Pope Leo XIV (impersonation) Video Relevant Radio
May 23, 2025 A video was released featuring Sam Altman and Jony Ive discussing a merger between OpenAI and Ive's hardware startup. The internet is debating whether the video is a deepfake or not, with some pointing to uncanny eye contact, balanced table reflections, and other subtle details as evidence of AI generation. The video is suspected to be a teaser for Sora2. Sam Altman and Jony Ive Video CryptoSlate
May 23, 2025 Attorneys at Butler Snow LLP used ChatGPT to generate legal citations for court filings in a case concerning Alabama prison conditions. The AI generated citations to cases that did not exist. The judge is considering sanctions and the firm's reputation is at risk. Butler Snow LLP The Baltimore Banner
May 22, 2025 A high school classmate created fake nude images of her and circulated them around school. Dorota Mani's daughter Image ColoradoPolitics.com
May 22, 2025 Scammers used AI-generated images and voices of a multinational firm CEO to steal millions of dollars. Multinational firm CEO Image Audio Tech Policy Press
May 22, 2025 AI-generated explicit images were circulated online, leading to the resignation of a city councilwoman. South Florida city councilwoman Image Tech Xplore
May 22, 2025 AI-generated sexually explicit images created without the subject's consent. AI 'nudification' websites allow users to upload an image, manipulate clothing, body shape and pose, and generate a sexually explicit photo. Taylor Swift, Melania Trump, South Florida city councilwoman Image Tech Xplore
May 22, 2025 An AI-generated summer reading list with fake titles appeared in a print insert in the Chicago Sun-Times and The Philadelphia Inquirer. Several titles were made up, including 'The Last Algorithm' by Andy Weir and 'The Collector's Piece' by Taylor Jenkins Reid. Freelancer Marco Buscaglia took responsibility for the piece and confirmed he used AI. Readers of Chicago Sun-Times and Philadelphia Inquirer, Authors whose fake books were promoted USA Today
May 22, 2025 AI-generated TikTok videos are used to trick users into executing PowerShell commands that download and install information-stealing malware (Vidar and StealC). The videos provide verbal and visual instructions, making it harder for traditional security systems to detect. The accounts used for the attacks are now inactive. TikTok users Video Audio Infosecurity Magazine
May 22, 2025 AI-generated deepfake images Texas teen Image ABC News
May 22, 2025 The Chicago Sun-Times published a summer book guide that included fake, AI-generated titles attributed to real authors like Isabel Allende and Percival Everett. Only five out of fifteen titles were genuine. The list was licensed from King Features, and Marco Buscaglia admitted to using AI to generate some of the content. Chicago Sun-Times readers, Isabel Allende, Percival Everett WBZ NewsRadio 1030
May 22, 2025 Scammers are using AI-generated voice messages to impersonate senior U.S. officials. They send text messages with malicious links or direct individuals to phishing sites. The aim is to gain access to personal accounts and steal money. The FBI has reported these incidents since April. Individuals, targeting personal account information and money. Audio MassLive
May 22, 2025 Orson Welles' voice was recreated using AI from hours of audio recordings to narrate location-based stories in the StoryRabbit app. The AI model learned from Welles' TV appearances and other mediums to generate new paragraphs in his accent and tone. The project has sparked controversy, with some finding it unethical, while others view it as a continuation of Welles' innovative legacy. Orson Welles Audio MovieWeb
May 22, 2025 Elliston Berry was a survivor of deepfake image-based sexual abuse committed when she was 14. This incident, along with the broader issue of deepfake pornography, inspired the Take It Down Act, which criminalizes the distribution of sexually explicit material without consent, including AI-generated "deepfake pornography". The law also mandates social media platforms to remove such images within 48 hours of notification and introduces penalties including prison sentences and fines. Elliston Berry (and other potential victims) Image Christianity Today
May 22, 2025 Lawyers with Butler Snow firm used ChatGPT to research supporting case law for court filings but did not verify the information, leading to nonexistent case citations. The judge is considering sanctions against the lawyers. The filings were made in a lawsuit filed by an inmate who was stabbed on multiple occasions. Alabama prison system Corrections1
May 22, 2025 Scammers are impersonating senior U.S. officials using AI-generated voicemails and text messages to trick recipients into divulging personal financial information. They send malicious links and may introduce malware to steal login credentials, targeting other government officials or their associates. iPhone and Android users, senior U.S. officials, government officials, their associates Audio WBIW
May 22, 2025 SAG-AFTRA filed a complaint against Epic Games' subsidiary, Llama Productions, alleging labor rights violations for using AI to replicate James Earl Jones' Darth Vader voice in Fortnite without proper consultation or union clearance. The AI voice was generated using Google's Gemini 2.0 Flash model and ElevenLabs' Flash v2.5 model. James Earl Jones's portrayal of Darth Vader Audio eWEEK
May 22, 2025 AI-generated videos of doctors and celebrities are used to mislead Australians into abandoning prescribed medications and purchasing unverified supplements. Dr. Norman Swan's likeness is being exploited in these deepfakes. Australians; Dr. Norman Swan Video Australian Broadcasting Corporation
May 22, 2025 Scammers are using AI to impersonate senior US officials via voice messages. They contact targets via text, then use AI-generated audio to impersonate public figures, friends, or family, sending malicious links to steal login information or push malware. US federal or state government officials and their contacts Audio Malwarebytes
May 22, 2025 Omny Miranda Martone was personally attacked with deepfake pornography. The content was posted on social media and emailed to her employer with demands to fire Martone, unaware that Martone was the company CEO. Omny Miranda Martone Image Forbes
May 22, 2025 The Chicago Sun-Times published a summer reading list that included ten AI-generated book titles that do not exist. A freelancer used AI to create the titles, and the paper is updating its policies to prevent this from happening again. Chicago Sun-Times 10News.com
May 22, 2025 AI-generated pornographic images of public figures and other women were widely circulated on social media platforms, especially X (formerly Twitter). The 'Take It Down Act' makes it a federal crime to distribute sexually explicit images—real or AI-generated—without the subject's consent and allows victims to sue creators and platforms that fail to remove them. Taylor Swift, Alexandria Ocasio-Cortez and women with no public profiles Image International Business Times UK
May 22, 2025 A high school student was arrested for creating and sharing sexually explicit deepfake images and videos that superimposed the faces of female celebrities and ordinary women onto nude bodies. He operated Telegram chat rooms where he shared the illicit content. 23 others were booked for allegedly producing or redistributing the content. Female celebrities and ordinary women Image Video Korea JoongAng Daily
May 22, 2025 Martina McBride testified at a Senate hearing about the NO FAKES Act. She shared a story about a fan who was scammed by someone impersonating her, leading the fan to sell their house and send the money to the impersonator. The method of impersonation is not explicitly stated, but it implied the use of deepfake audio or video or social media impersonation to convincingly mimic her. Martina McBride's fans Stereogum
May 21, 2025 Kayla Medeiros was a victim of deepfake images that were manipulated to make her look undressed. These images were found on an old iPad she shared with her ex-boyfriend. The 'Take It Down' Act, signed by President Donald Trump, makes publishing explicit AI-generated images illegal, offering protection and stricter penalties for the spread of such images. Kayla Medeiros Image KETV
May 21, 2025 Mentions an incident in late March involving unauthorized deepfake distribution causing harm, but does not give specifics on the target, modality or other details. Unknown Image Leader-Telegram
May 21, 2025 People are using AI to create deepfakes of OnlyFans models. OnlyFans models Video Mashable
May 21, 2025 A fan of Martina McBride was duped into believing they were communicating with her and ended up selling their house and sending the money to the scammer. Martina McBride's fans The Tennessean
May 21, 2025 A Toronto lawyer, Jisuh Lee, submitted a factum that included hallucinated cases generated by AI, misleading the court. She avoided contempt charges by taking responsibility and committing to remedial measures. Ontario Superior Court Justice Fred Myers Law.com
May 21, 2025 The article discusses the DEFIANCE Act, which aims to provide legal recourse for victims of non-consensual, sexually explicit deepfake imagery. It mentions that Alexandria Ocasio-Cortez, Billie Eilish and Taylor Swift have been targets of such deepfakes. Alexandria Ocasio-Cortez, Billie Eilish, Taylor Swift Image Norwood News
May 21, 2025 The Chicago Sun-Times published a summer reading list including AI-generated fictional books attributed to real authors. The list was created by a freelancer using AI, which generated book titles and details that do not exist. The newspaper removed the list and is reviewing its relationship with third-party contractors. Chicago Sun-Times readers, Isabel Allende, Rebecca Makkai, Min Jin Lee NBC News
May 21, 2025 Elliston Berry and Francesca Mani were victims of deepfakes at age 14. Digitally altered nude images of themselves and friends online were generated using AI. Incidents in schools in the U.S. totalled nearly 30 over the last 20 months. First Lady Melania Trump invited Berry and Mani to a roundtable discussion on the “Take It Down Act.” On May 19, 2025, President Donald Trump signed the Take It Down Act into law to punish individuals who are abusing others through deepfakes or online sexual exploitation. Elliston Berry and Francesca Mani Image American Family Association
May 21, 2025 A deepfake video was posted on X depicting Donald Trump saying Pride Month is canceled. The video, which labeled itself as a deepfake, went viral on social media and had 2.2 million views as of May 21. The video was created by an account named Maverick Alexander. Donald Trump Video USA Today
May 21, 2025 An AI-generated clone of Mark Brown's voice is being used without his knowledge or consent to narrate Doom videos on a YouTube channel called Game Offline Lore. Brown filed a privacy complaint with YouTube. The channel has over 60,000 views, and is potentially making ad revenue. Mark Brown (Game Maker's Toolkit) Audio WIRED
May 21, 2025 A gaming YouTuber, Mark Brown, discovered that an AI-generated clone of his voice was being used without his consent to narrate Doom videos on the 'Game Offline Lore' YouTube channel. Brown filed a privacy complaint with YouTube, as the channel was profiting from the videos using the AI-generated voice. Mark Brown (Game Maker's Toolkit) Audio WIRED
May 21, 2025 A YouTube channel called Game Offline Lore used an AI-generated clone of Mark Brown's voice to narrate Doom videos without his knowledge or consent. Brown filed a privacy complaint to YouTube, but the videos remained live for over 48 hours. The channel is profiting from the videos, which have garnered over 60,000 views. Mark Brown (Game Maker's Toolkit) Audio WIRED
May 21, 2025 Omny Miranda Martone, founder and CEO of the Sexual Violence Prevention Association, was targeted with several deepfake pornography attacks. Disgusting violating images of ‘me’ were shared on social media and emailed to my organization in an attempt to silence my advocacy. Omny Miranda Martone Image Rolling Stone
May 21, 2025 Omny Miranda Martone, founder and CEO of the Sexual Violence Prevention Association, was targeted with several deepfake pornography attacks. Disgusting violating images of ‘me’ were shared on social media and emailed to my organization in an attempt to silence my advocacy. Omny Miranda Martone Image Rolling Stone
May 21, 2025 A syndicated summer reading list published in the Chicago Sun-Times and The Philadelphia Inquirer was found to be largely fake, generated by AI. The list of 15 books was a syndicated piece by King Features. Freelance writer Marco Buscaglia admitted to partially generating the piece using AI. The fake books were paired with fake descriptions. The newspapers have distanced themselves and promised to investigate. Chicago Sun-Times, The Philadelphia Inquirer VICE
May 21, 2025 Cybercriminals used fake Facebook pages and ads impersonating Kling AI to distribute malware. Users were lured to spoofed websites where they were tricked into downloading a malicious file disguised as AI-generated images or videos. The malware gave attackers remote control of the victim's system and the ability to steal sensitive data. The campaign used a remote access trojan (RAT) called PureHVNC. Users of Kling AI Image Video The Hacker News
May 21, 2025 Former NewsChannel 5 meteorologist Bree Smith was a victim of deepfakes. Images of a semi-nude body with her face superimposed on it had been circulating online. Bree Smith Image The Tennessean
May 21, 2025 A classmate used an app to create nude deepfakes from images taken from her Instagram account and shared them on Snapchat. Ellison Berry Image EL PAÍS English
May 21, 2025 The Chicago Sun-Times published a summer reading list containing AI-generated book titles. Ten of the fifteen books listed were fake, and real authors' names were associated with them. The paper apologized and updated its policies. Readers of the Chicago Sun-Times, authors whose names were associated with fake books CBS News
May 20, 2025 A freelance writer for King Features generated a summer reading list using AI, featuring non-existent books attributed to real authors, and published it in the Chicago Sun-Times. The writer used generative ai tools to make up fake books by real authors. Chicago Sun-Times readers, authors Isabel Allende, Andy Weir, Brit Bennett Snopes
May 20, 2025 The Chicago Sun-Times printed an AI-generated summer reading list that included fake book titles attributed to real authors. The article, licensed from a third party, was created using AI, and the author admitted to not fact-checking the generated content. This led to backlash for promoting nonexistent books and misrepresenting authors' works. Authors (e.g., Isabel Allende, Rebecca Makkai), Chicago Sun-Times HuffPost
May 20, 2025 50 Cent posted an AI-generated picture of himself wearing a 'Free Diddy' shirt on Instagram in front of a courthouse, along with other posts referencing the Diddy situation and Kid Cudi's expected testimony. Diddy Image Billboard
May 20, 2025 The Chicago Sun-Times published AI-generated content, including fake book recommendations attributed to real authors and articles quoting nonexistent experts. A 'national content partner' provided the content. A credited author also admitted using AI to generate content and not thoroughly checking facts. The Sun-Times is removing the content and updating its third-party content policies. Chicago Sun-Times readers, Min Jin Lee, Rebecca Makkai, Padma Lakshmi The Verge
May 20, 2025 Snapchat refused for nearly a year to remove an AI-generated “deepfake” of Elliston Berry, who was 14 at the time. Elliston Berry Image AP News
May 20, 2025 The Chicago Sun-Times published a summer reading list that included books generated by AI. The books and some of the experts quoted in other articles in the insert did not exist. The paper is investigating how this happened and is updating its policies to ensure that all third-party licensed editorial content meets the same editorial standards as content created in-house. Chicago Sun-Times readers CBC
May 20, 2025 A syndicated insert titled "Summer reading list for 2025" featured in both papers included numerous nonexistent books. Marco Buscaglia admitted to using AI to generate the list and failing to properly verify the information. Chicago Sun-Times, Philadelphia Inquirer PCMag
May 20, 2025 A syndicated summer book list containing made-up books by famous authors (Isabel Allende, Percival Everett) was published in major newspapers. The list was partly generated by Artificial Intelligence. Only 5 of the 15 books were real. Readers of Chicago Sun-Times and The Philadelphia Inquirer NPR
May 20, 2025 Epic Games (via Llama Productions) allegedly used AI to replicate Darth Vader's voice in Fortnite without notifying the union or the original performers. The AI allows players to interact with the Darth Vader character in real-time. SAG-AFTRA filed an unfair labor practice charge, arguing that the company made unilateral changes to employment terms without providing notice or opportunity to bargain. Hollywood actors' union (SAG-AFTRA) Audio Hindustan Times
May 20, 2025 The Chicago Sun-Times published an AI-generated summer reading list, including non-existent books by real authors due to 'AI hallucination.' The Philadelphia Inquirer was also accused of publishing the same fake reading list. The list was created by a freelancer working with a content partner and included fake titles like *Hurricane Season* by Brit Bennett, *Nightshade Market* by Min Jin Lee, and *The Longest Day* by Rumaan Alam, along with fake descriptions. Other AI-generated content was also found, such as quotes from non-existent experts. Chicago Sun-Times, Philadelphia Inquirer, Brit Bennett, Min Jin Lee, Rumaan Alam The Guardian
May 20, 2025 Defense lawyers for Jeff Dunn, being sued by Frankie Johnson, allegedly used fictitious, potentially AI-generated case citations in a court filing. Johnson's lawyer claims the cited sources do not exist, and the judge confirmed their absence through independent searches. The court is investigating the attorneys for potential sanctions related to false statements. Frankie Johnson Yellowhammer News
May 20, 2025 Fortnite introduced an AI Darth Vader using James Earl Jones' voice, leading to controversy when gamers tricked it into saying slurs. SAG-AFTRA filed an unfair labor complaint against Epic Games, arguing the use of AI violated their agreement by replacing human performers. James Earl Jones/SAG-AFTRA Audio futurism.com
May 20, 2025 The Chicago Sun-Times published a summer reading list with AI-generated book recommendations, falsely attributing books to authors like Isabel Allende and Andy Weir. The books and descriptions were fabricated. Chicago Sun-Times readers, Isabel Allende, Andy Weir 404 Media
May 20, 2025 Civitai, an AI model sharing site, had a configuration issue that allowed users to generate nonconsensual pornographic videos of real people, including non-celebrities. Although Civitai claims to have fixed the issue for celebrities, it was still allowing non-consensual videos of non-celebrities to be generated at the time of the report. Non-celebrity Civitai users Video 404 Media
May 20, 2025 Epic Games (Llama Productions) allegedly used AI-generated voices in Fortnite to replace the work of human voice actors without proper negotiation with the actors' union, SAG-AFTRA. The specific case involves a Darth Vader non-player character. SAG-AFTRA (American actors' union) Audio theregister.com
May 20, 2025 Attackers are leveraging advanced AI technologies to conduct targeted attacks through smishing and vishing. AI-generated audio mimics well-known public figures or trusted contacts, making it challenging to discern authenticity. Attackers impersonate individuals familiar to their targets, utilizing spoofed numbers, AI-generated voices, and personal photos sourced from public domains. Top U.S. officials and their associates Audio Rude Baguette
May 20, 2025 Fortnite used an AI-generated voice of Darth Vader, based on the late James Earl Jones' voice, allowing players to interact with the character in real-time. SAG-AFTRA filed an unfair-labor-practice complaint against Epic Games, arguing that the agreement with Jones' estate doesn't cover replacing other voice actors with AI without proper agreement with the union. SAG-AFTRA and other voice actors who have portrayed Darth Vader Audio GameSpot
May 20, 2025 Llama Productions, a subsidiary of Epic Games, allegedly used AI-generated voices to replace human voice actors in Fortnite for the Darth Vader chatbot without proper notification or bargaining with the union, SAG-AFTRA. The union has filed an unfair labor practice charge. SAG-AFTRA (video game voice actor union) Audio Rock Paper Shotgun
May 20, 2025 Epic Games (Llama Productions) allegedly used AI to recreate Darth Vader's voice in Fortnite without informing or bargaining with the actors' union (Sag-Aftra). The union filed a complaint alleging unfair labor practices, as the company is accused of replacing the work of human performers with AI technology without proper negotiation. Players were reportedly able to manipulate the AI voice to generate inappropriate content. James Earl Jones (estate) and voice actors Audio BBC
May 20, 2025 Epic Games subsidiary Llama Productions deployed an AI-powered Darth Vader chatbot in Fortnite that imitated the voice of deceased voice actor James Earl Jones (with permission from his estate) using Google Gemini 2.0 Flash and ElevenLabs Flash v2.5. The AI character made offensive statements and SAG-AFTRA filed an unfair labor practice charge, arguing that Llama replaced human performers with AI technology without negotiation. James Earl Jones (estate), SAG-AFTRA Audio Game Developer
May 20, 2025 AI-generated image depicting a Pakistani truck transporting the wreckage of an Indian aircraft was shared on social media, falsely claiming it was real. The image was created using AI and showed distortions, such as an incorrect license plate, revealing its fabrication. India Image Yahoo
May 20, 2025 Epic Games' Fortnite used AI to recreate James Earl Jones' Darth Vader voice. SAG-AFTRA filed a complaint alleging replacement of human performers without notice or bargaining. The game allows players to speak with Darth Vader via conversational AI. James Earl Jones' Darth Vader voice Audio hypebeast.com
May 20, 2025 Illicit deepfake images of Taylor Swift spread through X. X temporarily banned searches using Taylor Swift’s name in response. Taylor Swift Image Cointelegraph
May 20, 2025 The Take It Down Act has been signed into law, criminalizing the non-consensual online publication of intimate images, including deepfakes. Tech platforms are mandated to remove such content within 48 hours of notification. The law, supported by both Democrats and Republicans, is a response to the rise of deepfake pornography and non-consensual image abuse. High-profile figures like Taylor Swift and Jamie Lee Curtis, as well as underage children, have been victims of AI-generated images shared online without consent. Taylor Swift, Jamie Lee Curtis, underage children Image Decrypt
May 20, 2025 Explicit deepfakes, where a person’s face is superimposed on a nude body using artificial intelligence. A classmate of Texas high schooler Berry shared on Snapchat an image of her that he’d taken from her Instagram and altered using AI to make it look like she was nude. Taylor Swift, Rep. Alexandria Ocasio-Cortez, high school girls, Elliston Berry, Francesca Mani Image CNN
May 20, 2025 Dhruv Rathee created a YouTube video titled 'The Sikh Warrior Who Terrified the Mughals' which included AI-generated visuals of Sikh Gurus. This sparked backlash from the Akal Takht, Shiromani Akali Dal (SAD), and the Shiromani Gurdwara Parbandhak Committee (SGPC), as depicting Sikh gurus in human form is considered inappropriate. The Delhi Sikh Gurdwara Management Committee (DSGMC) filed a complaint with the Cyber Crime Cell, leading to the video being removed. Sikh Gurus and Sikh community Video Image Hindustan Times
May 19, 2025 An AI-generated deepfake image of Elliston Berry, then 14 years old, was posted on Snapchat. The platform refused to remove it for almost a year. This incident inspired the Take It Down Act. Elliston Berry Image USA Today
May 19, 2025 Boys as young as 14 created and shared AI-generated pornographic images of female classmates on social media sites like Snapchat. Teenage girls, specifically students Image Education Week
May 19, 2025 Taylor Swift became a victim of explicit deepfake images made in her likeness once they were posted on X and disseminated across other social media platforms. Taylor Swift Image The Independent
May 19, 2025 SAG-AFTRA has filed charges against Llama Productions (Fortnite) for using AI to replicate James Earl Jones' Darth Vader voice without union agreement, potentially replacing voice actors. James Earl Jones/SAG-AFTRA Audio Star Wars News Net
May 19, 2025 Epic Games (Llama Productions) implemented an AI-voiced Darth Vader NPC in Fortnite, allegedly undermining the work of human SAG-AFTRA members. The AI Darth Vader can have conversations with players over voice chat. SAG-AFTRA filed an unfair labor practice charge, claiming Epic used AI without bargaining over terms, replacing human performers' potential work. SAG-AFTRA video game actors Audio IGN
May 19, 2025 Fortnite introduced an AI voice for Darth Vader, allowing players to interact with the character. SAG-AFTRA filed an unfair labor practice charge against Llama Productions (Fortnite's signatory company), claiming they replaced human performers with AI technology without proper notice or bargaining. The union argues that this undermines voice actors who previously matched Darth Vader's voice in video games. SAG-AFTRA Audio Gizmodo
May 19, 2025 Epic subsidiary Llama Productions implemented an AI-generated Darth Vader voice in Fortnite using Google's Gemini 2.0 to generate dialogue and ElevenLabs' Flash v2.5 AI model trained on the voice of James Earl Jones, without notifying or bargaining with the union. Players discovered they could manipulate the AI into using profanity and inappropriate language. James Earl Jones/SAG-AFTRA Audio Ars Technica
May 19, 2025 Epic Games implemented an AI-powered Darth Vader in Fortnite that could be tricked into saying slurs using James Earl Jones's voice. SAG-AFTRA filed an unfair labor practice complaint alleging Epic's use of AI-generated voice constituted 'unilateral changes' to terms and conditions of employment covered by union bargaining. James Earl Jones, SAG-AFTRA Audio PC Gamer
May 19, 2025 Epic Games used an AI-generated version of Darth Vader's voice in Fortnite, with permission from Disney. SAG-AFTRA filed an Unfair Labor Practice (ULP) against Epic Games, alleging that the use of AI-generated voice violates fair labor practices, especially during the SAG-AFTRA Interactive Media Strike. James Earl Jones Audio Engadget
May 19, 2025 Llama Productions (Fortnite) allegedly used an AI-powered voice mimicking James Earl Jones' Darth Vader without notifying or negotiating with SAG-AFTRA, the actor's union. This is considered a violation of labor practices as it undermines bargaining unit work, potentially replacing voice actors. James Earl Jones/SAG-AFTRA Audio JoBlo
May 19, 2025 Llama Productions, a subsidiary of Epic Games, allegedly used AI to generate Darth Vader's voice in Fortnite, replacing actors' work without notice or bargaining with SAG-AFTRA. Actors who previously matched Darth Vader's voice in video games Audio AP News
May 19, 2025 President Trump signed the “Take It Down Act,” a bipartisan bill that targets explicit AI-generated deepfakes. Victims of explicit AI-generated deepfakes NBC News
May 19, 2025 Epic Games' Llama Productions used AI to recreate James Earl Jones' Darth Vader voice in Fortnite without SAG-AFTRA's consent. SAG-AFTRA filed an unfair labor practice charge, arguing this use of AI replaces the work of human performers and violates their right to bargain terms. The union does not appear to be against using digital replicas of deceased actors, as long as actors and the union are compensated and can bargain terms for their use. James Earl Jones (posthumously) and SAG-AFTRA Audio Variety
May 19, 2025 An AI-generated replica of James Earl Jones’ voice as Darth Vader was used in 'Fortnite' without notifying or bargaining with SAG-AFTRA. The actors' union has filed an unfair labor practice charge. The voice was created after Jones signed an agreement permitting replicas for future use, but SAG-AFTRA argues bargaining is still required. Epic Games worked with Jones’ estate to develop the AI voice. SAG-AFTRA Audio TheWrap
May 19, 2025 SAG-AFTRA filed an unfair labor practice charge against Fortnite's production company, alleging that its use of an AI-powered James Earl Jones Darth Vader voice infringes on the union's right to negotiate major changes to its collective bargaining agreement. The union claimed that Llama Productions, made “unilateral” changes to terms and conditions of employment when Fortnite began employing the use of an AI-powered Vader voice starting Friday without giving the union notice or the ability to negotiate. SAG-AFTRA Audio The Hollywood Reporter
May 19, 2025 Fortnite implemented an AI-generated voice mimicking James Earl Jones as Darth Vader without negotiating with SAG-AFTRA, potentially replacing the work of voice actors who previously performed the role in video games. The AI voice was also reportedly prompted to use slurs. SAG-AFTRA, voice actors, specifically those who previously matched Darth Vader's voice Audio Screen Rant
May 19, 2025 A 2022 deepfake video of Ukraine's President Volodymyr Zelenskyy appearing to urge Ukrainian soldiers to surrender to Russian forces. The video was quickly debunked. Volodymyr Zelenskyy Video CNET
May 19, 2025 Risto Bergman, a telecoms worker, used an AI app to generate indecent images of young girls being abused. The images were so realistic they were mistaken for authentic photographs. He used sexually descriptive search terms, and the AI drew upon a digital library of real child abuse images. He was sentenced and added to the sex offenders' register. Children Image Sky News
May 19, 2025 Explicit deepfake images of Elliston Berry were created by a classmate using a computer program. The images were difficult to remove from social media, highlighting the need for legislation like the Take It Down Act. Elliston Berry Image FOX 4 News Dallas-Fort Worth
May 19, 2025 AI-generated images circulated online falsely depicting Billie Eilish and Katy Perry at the Met Gala. Billie Eilish was shown in an oversized navy blazer with fake roses, and a black corset with feathers. Katy Perry also had a fake image circulating. Billie Eilish and Katy Perry Image WJBR.com
May 19, 2025 Law&Crime is using generative AI to recreate Sean "Diddy" Combs' sex trafficking trial proceedings due to a courtroom camera ban. The AI-generated videos are based on official court transcripts and depict the words spoken by witnesses, investigators, and legal figures. Concerns have been raised about the potential misrepresentation of jurors and the resemblance of AI-generated faces to real individuals. Sean "Diddy" Combs Video PetaPixel
May 19, 2025 Law&Crime is recreating Sean "Diddy" Combs' sex trafficking trial with generative AI due to the courtroom camera ban. They are releasing AI-generated video recreations of the trial based entirely on official court transcripts. The recreated testimony and trial highlights will be available on Law&Crime’s YouTube channel. Some legal experts have raised concerns about showing jurors in the AI videos. Sean "Diddy" Combs trial Video PetaPixel
May 19, 2025 50 Cent shared a fake AI-generated video on Instagram showing Diddy riding pillion on a motorcycle driven by Jeffrey Epstein. This was done to troll Diddy amidst his sex trafficking trial. Sean 'Diddy' Combs Video The Mirror US
May 19, 2025 Snapchat refused for nearly a year to remove an AI-generated “deepfake” of the then 14-year-old Elliston Berry. Elliston Berry Image PBS
May 19, 2025 An AI-generated image was created depicting a monument of Rodrigo Duterte. AI detection tools indicate a high likelihood of AI generation and face manipulation within the image. Rodrigo Duterte Image Rappler
May 19, 2025 Cybercriminals are using AI-generated voice messages, impersonating senior US officials, in smishing campaigns to get the target to click on malicious links to access personal accounts. A similar cybercrime involved malicious actors pretending to be US government officials in calls with Middle Eastern students in the US with valid visas. Current and former senior US federal and state employees, and their contacts Audio PCMag
May 19, 2025 An AI-generated deepfake of Elliston Berry, a 14-year-old, was circulated on Snapchat and was not removed for almost a year, inspiring the Take It Down Act. Elliston Berry Image Bergen Record
May 19, 2025 Dhruv Rathee created a video featuring AI-generated images of Guru Gobind Singh and his sons, leading to demands for its removal by SGPC and SAD. Guru Gobind Singh and his four sons (Sahibzadas) Image Video Deccan Herald
May 19, 2025 Attackers use smishing texts and AI-generated vishing voice messages to harvest credentials and take over accounts. Compromised accounts can be used to reach additional officials. current or former federal and state officials and their contacts Audio Gov1
May 19, 2025 Deepfakes are being used to impersonate well-known personalities and company executives to trick people into handing over money or personal information. Examples include fake celebrity endorsements of investment scams, impersonation of executives in video calls, and misinformation campaigns. A fake video of Raymond Ackerman promoting a money-doubling scheme linked to Pick n Pay appeared online. Scams using altered footage of Elon Musk and other public figures have also circulated. Raymond Ackerman, Elon Musk, Pick n Pay, Old Mutual Customers Video IT News Africa
May 19, 2025 A video of Donald Trump playing piano and guitar was created using AI and shared on Truth Social and X/Twitter. The video depicted him playing 'Don't Stop Believin' by Journey. Donald Trump Video Indy100
May 19, 2025 AI-generated deepfake videos, images, and messages purporting to depict the new pontiff. These media fabrications present the pope delivering messages he never said, sometimes even in his own voice. For example, a YouTube video entitled, “POPES WAKEUP URGENT CALL TO ALL TRUE CHRISTIANS || POPE LEO XIV SPEECH,” posted on a channel called “Pope Leo XIV Sermons,” delivers a fiery 42-minute exhortation about the end times in an AI-generated voice based on that of Pope Leo. Pope Leo XIV Video Image Audio Where Peter Is
May 19, 2025 Relatives of Christopher Pelkey created an AI-generated video of him to appear as if he was addressing the court during the sentencing hearing of Gabriel Horcasitas, who was convicted of manslaughter in Pelkey's death. The video used a script written by Pelkey's sister, an image of his face, and a voice to mimic his. The defense attorney is appealing the sentence, arguing that the use of the AI video was inappropriate. Gabriel Horcasitas Video Inquirer.com
May 19, 2025 Elliston Berry was the victim of a nude deepfake that wasn’t removed from Snapchat until Cruz’s Senate office stepped in. Berry was 14 when the deepfake was created. Elliston Berry Image USA Today
May 19, 2025 Deepfakes have been used to create videos of Taylor Swift to promote fraudulent cryptocurrency schemes. Voice-based deepfake attacks target corporations. AI-generated scams are using the voices of family members to ask for money. Taylor Swift, corporations, individuals Video Audio Image ITWeb
May 19, 2025 A woman named Beth Hyland was scammed by an online scam artist posing as a French man named Richard. The scam artist used deepfake videos on Skype calls and posted photos of another man to deceive the victim. Beth Hyland Video Image The Japan Times
May 19, 2025 Spotify podcasts used AI-generated voices to promote illegal online pharmacies, selling controlled substances like Adderall and Xanax. The podcasts, discoverable through common search terms, linked users to dubious pharmacy websites. Spotify removed 26 podcasts after being flagged, but new violations continued to surface. Spotify users Audio Storyboard18
May 18, 2025 AI-powered Darth Vader character in Fortnite used James Earl Jones' voice to swear at players. Epic Games implemented a fix to prevent future occurrences. James Earl Jones (posthumously) / Darth Vader character Audio Business Insider
May 18, 2025 The segment discusses the Take It Down Act and its implications for deepfake pornography and revenge porn. It mentions the takedown of the website Mr. Deepfakes, which created hyper-realistic deepfake pornography using images and faces, impacting millions of women. The site had 18 million users at its peak. The person behind the website was confronted and was living a double life. Potentially Millions of Women Image Video PBS
May 18, 2025 Deepfake videos were created to falsely depict Mauricio Macri encouraging people to vote for Manuel Adorni and Silvia Lospennato stepping down and calling to vote for Adorni during the Buenos Aires City legislative elections. Macri accused people from La Libertad Avanza (LLA) of publishing it. Mauricio Macri and Silvia Lospennato Video Buenos Aires Herald
May 18, 2025 Malicious actors are using AI-generated voice memos combined with deceptive text messages (smishing and vishing) to impersonate senior US officials. The goal is to build trust and gain access to personal accounts, potentially leading to further compromises and information theft. They send malicious links to steal login credentials or install malware. Current and former senior US federal or state government officials and their contacts Audio Hackread
May 18, 2025 AI-generated video of Donald Trump playing piano and guitar to 'Don't Stop Believin' by Journey, shared on TikTok and Twitter. The video features Trump in different musical scenarios, including playing drums and wearing American-themed attire. Donald Trump Video UNILAD
May 18, 2025 Pornographic, AI-generated pictures of Taylor Swift flooded social media platform X, causing it to temporarily block searches for her name. Taylor Swift Image Behavioral Scientist
May 18, 2025 An AI-generated deepfake video depicts Jeff Kitner, a Dallas City Council candidate, saying words and engaging in activities like riding a rollercoaster and wearing dirty clothes. The video was created by a supporter of his opponent. Jeff Kitner Video WFAA
May 18, 2025 An AI-generated deepfake video depicts Jeff Kitner, a candidate in a Dallas City Council runoff, in a negative and satirical manner. The video was created by a supporter of his opponent and shows Kitner saying words (using some real audio) while riding a rollercoaster, drinking coffee, and wearing dirty clothes. Jeff Kitner Video WFAA
May 17, 2025 Hackers are using AI-generated voice messages to impersonate individuals and target senior U.S. officials and their contacts. The hackers try to establish rapport before gaining access to personal accounts. Current or former senior U.S. federal and state government officials as well as their contacts Audio Scripps News
May 17, 2025 Hackers are using AI-generated voice messages to impersonate senior U.S. officials to establish rapport before gaining access to personal accounts. The FBI advises caution, looking for imperfections in images/videos, and careful examination of contact information. Current or former senior U.S. federal and state government officials as well as their contacts Audio Scripps News
May 17, 2025 Grok chatbot was manipulated to generate false claims of 'white genocide' in South Africa, reflecting political biases of Elon Musk. The system prompts were modified without authorization to influence the AI's responses, which violates 'internal policies and core values'. Public trust in AI; potentially South African farmers CNBC
May 17, 2025 Deepfake videos and audio featuring Ibrahim Traore, the military leader of Burkina Faso, are being used to portray him as a pan-African hero and spread misinformation. These deepfakes include music videos featuring celebrities like Beyoncé, Selena Gomez, and Rihanna alongside Traore. Some videos mimic news reports with false claims about Traore and his government. A network of Facebook accounts amplified false claims about Russian support for Traore after allegations were made in the US Senate. Ibrahim Traore Video Audio BBC
May 16, 2025 Cyber campaign using AI-generated voice and text messages to impersonate senior U.S. government officials to deceive victims into giving up sensitive personal information and account access. Attackers use smishing and vishing, spoofed numbers, AI voices, and personal photos pulled from public sources. Once trust is established, they urge the victim to switch to another platform that may contain malware or direct them to fake login pages to steal credentials. Senior U.S. government officials and their associates Audio Interesting Engineering
May 16, 2025 Attackers are using AI-generated voice and text messages to impersonate senior U.S. government officials. The scheme involves smishing and vishing to trick victims into clicking on links or entering personal details on fraudulent sites. The messages often appear to come from high-level U.S. officials, with AI-generated audio mimicking known public figures or trusted contacts. Senior U.S. government officials, current and former federal and state officials, and their associates. Audio Interesting Engineering
May 16, 2025 Law firms representing former Los Angeles County District Attorney Jackie Lacey used AI to generate legal citations in a lawsuit against State Farm, submitting briefs with false, inaccurate, and misleading legal citations. Approximately nine of 27 citations in a ten-page brief were incorrect, with at least two authorities cited not existing and several quotes being misattributed. The law firms, K&L Gates and Ellis George LLP, were sanctioned and ordered to pay $31,100. Judge Michael Wilner Latin Times
May 16, 2025 AI-voiced Darth Vader in Fortnite used profanity due to an AI voice implementation error. A Twitch streamer's conversation triggered Vader to repeat vulgar words. Epic Games released a hotfix to address the issue. Loserfruit (Twitch Streamer), Fortnite Players Audio Ars Technica
May 16, 2025 The FBI has issued a warning about an ongoing campaign using AI to impersonate senior U.S. officials through voice and text messages. This scheme involves 'smishing' and 'vishing' attacks, designed to trick targets into giving up personal information. Attackers are sending AI-generated voice messages claiming to be from high-ranking government figures to build trust before requesting a move to another platform where they can send malicious links or request sensitive data. U.S. federal or state government officials, as well as their contacts. Audio Straight Arrow News
May 16, 2025 Malicious actors impersonate senior U.S. officials using malicious text messages and AI-generated voice messages (voice cloning). These messages target current and former federal and state officials to establish a rapport and gain access to personal accounts, information, or funds. The use of AI-based voice cloning surged by 442% between the first half and the second half of 2024. Senior U.S. officials; current and former federal and state officials Audio Cybersecurity Dive
May 16, 2025 The FBI is warning about a threat campaign where malicious actors are impersonating senior U.S. officials using malicious text messages and AI-generated voice messages to build rapport and potentially gain access to personal accounts, which can lead to more information or funds. CrowdStrike reported a 442% surge in AI-based voice cloning between the first and second halves of 2024. Senior U.S. officials Audio Cybersecurity Dive
May 16, 2025 Scammers are impersonating a senior US official using faked audio. They send malicious links disguised as transitions to other messaging platforms. After gaining access they contact a specific target pretending to be the official and use an attached voice message to prove their identity. Targeted individuals Audio PCWorld
May 16, 2025 Cybercriminals are impersonating senior US officials in smishing and vishing attacks using deepfake and generative AI to create credible audio and text messages. They attempt to move victims to secondary messaging platforms. Senior US federal and state government officials Audio TechRadar
May 16, 2025 Fortnite used AI to recreate James Earl Jones' Darth Vader voice using Google’s Gemini 2.0 and ElevenLabs’ Flash v2.5 models. Players exploited the AI to make Vader say inappropriate words, but Epic Games patched the AI to prevent swearing. Darth Vader character in Fortnite Audio Gizmodo
May 16, 2025 A short film showed each of the European leaders as a baby saying “Welcome to Albania” in their native language. European leaders at the European Political Community in Tirana, Albania Video politico.eu
May 16, 2025 Malicious actors have impersonated senior US officials to target individuals, many of whom are current or former senior US federal or state government officials and their contacts. The cybercriminals send text and AI-generated voice messages to establish trust with targets. Perpetrators send targeted individuals a malicious link to gain access to personal and official accounts. Once access is obtained, it can be leveraged to target other government officials, their associates, or other contacts. US officials Audio Tech Monitor
May 16, 2025 FBI warns of AI-generated audio deepfakes used in phishing attacks targeting US officials. Perpetrators impersonate senior officials via 'smishing' (text) and 'vishing' (voice) to establish trust, then send malicious links to gain access to accounts. Information gathered can be used to target other officials or extract information/funds. US officials Audio Tech Monitor
May 16, 2025 A video was circulated on social media platforms depicting Pakistan's Prime Minister, Shehbaz Sharif, conceding defeat to India in an ongoing conflict and lamenting Pakistan's international isolation. The audio in the video was determined to be AI-generated after analysis by the Deepfake Analysis Unit (DAU). They used AI detection tools Hiya, Deepfake-O-Meter, Hive, and ElevenLabs Classifier. Shahbaz Sharif, Prime Minister of Pakistan Video Audio Vishvas News
May 16, 2025 Malicious actors impersonated senior US officials using AI-generated voice messages (vishing) and SMS messages (smishing) to gain unauthorized access to personal or official accounts. They tricked victims into clicking malicious links to switch messaging platforms. The attacks have been ongoing since at least April 2025. US federal or state government officials Audio Infosecurity Magazine
May 16, 2025 Malicious actors impersonated senior US officials in AI-powered SMS and voice phishing schemes (smishing and vishing). They sent text messages and AI-generated voice messages, attempting to gain unauthorized access to personal or official accounts by tricking victims into clicking malicious links to switch messaging platforms. Once accessed, they use contact information to target other officials and associates for sensitive information or financial resources. Senior US federal or state government officials and their contacts Audio Infosecurity Magazine
May 16, 2025 Hackers are using AI voice clips and text messages to impersonate senior US officials. The goal is to breach personal accounts of government personnel by building trust and redirecting them to external platforms to harvest login credentials. Stolen data is used to access other government officials or their contacts to elicit sensitive information or financial resources. US Federal and State Government Personnel Audio The Express Tribune
May 16, 2025 Hackers are using AI voice clones to impersonate US government officials to gain access to personal accounts. In another instance, a Ferrari executive stymied a similar attack by asking about a book recommended by the person being impersonated. British engineering company Arup paid out $25 million to scammers who set up a false video call meeting to trick an employee. A British energy firm was targeted using AI-generated calls to a cost of more than £200,000. US Government Officials, Ferrari executive, British engineering company Arup, British energy firm Audio Video IT Pro
May 16, 2025 Hackers impersonated senior US officials using AI-generated voice messages to try to break into online accounts. They sent texts and voice messages to targets since April to build rapport. The goal remains unclear. US federal and state government officials Audio WION
May 16, 2025 In 2020, a bank manager in Hong Kong was tricked into transferring $35 million after receiving a phone call from someone he believed to be a company director. The fraudster used AI-based voice cloning to perfectly mimic the executive’s voice, and backed up the request with convincing emails and documentation. Bank manager in Hong Kong Audio Help Net Security
May 16, 2025 AI-generated images of Billie Eilish were created depicting her at the 2025 Met Gala. Billie Eilish confirmed that she did not attend the event and the images were fake. She was performing in Amsterdam on the same day. Billie Eilish Image Just Jared
May 15, 2025 Malicious actors are impersonating senior U.S. officials using AI-generated voice memos (vishing) and text messages (smishing) to establish rapport, gain access to personal accounts through malicious links, and target other officials or their associates using stolen information. The goal is to elicit information or funds. Current and former senior U.S. federal or state government officials and their contacts Audio CNBC
May 15, 2025 Jack Gillard, 25, was found in possession of AI generated images of child abuse depicting young girls being raped by adult men. Children Image Wales Online
May 15, 2025 Seth Herrera, an El Paso soldier, was indicted for using AI chatbots to generate CSAM using images and videos of children he knew. He allegedly took images and videos of those children undressing in his home and used them to generate the CSAM. Children known to Seth Herrera Image Video KEYE
May 15, 2025 AI-generated deepfakes falsely placed Billie Eilish and Katy Perry at the Met Gala. Billie Eilish debunked the AI image on Instagram, stating she was in Amsterdam for shows. Perry also addressed AI images of her, clarifying her absence due to her tour. Billie Eilish and Katy Perry Image Billboard
May 15, 2025 Beth Hyland was scammed by an online persona named 'Richard' who used deepfake video calls on Skype. 'Richard' used manipulated video or audio to look and sound real. Beth sent 'Richard' $26,000. Beth Hyland Video Context News
May 15, 2025 An AI-generated video featuring the likeness and voice of Christopher Pelkey, a murder victim, was used to deliver a victim impact statement at the sentencing hearing of his killer, Gabriel Paul Horcasitas. The victim's sister scripted the statement. The AI-Pelkey expressed forgiveness towards Horcasitas, who was convicted of manslaughter and sentenced to 10 and a half years in prison. Gabriel Paul Horcasitas Video Audio The Jerusalem Post
May 15, 2025 A deepfake video of Colonel Sofia Qureshi was created where she is made to say, “I am a Muslim, but not a Pakistani. I am a Muslim, but not a terrorist.” The video was shared by Pakistani users. Fact checking using DeepFake-o-Meter confirmed it to be a deepfake. Colonel Sofia Qureshi Video DFRAC
May 15, 2025 Deepfake videos of PM Modi, Home Minister Amit Shah, and External Affairs Minister S Jaishankar were circulated with misleading claims by Pakistani users. The videos were created using AI tools for propaganda purposes, falsely claiming that these leaders have publicly accepted defeat after Indian air strikes on terrorist camps in Pakistan and PoK. Analysis revealed unnatural lip movements and AI-generated audio tracks. PM Modi, Amit Shah, S Jaishankar Video Audio Vishvas News
May 14, 2025 Students are using AI deepfake porn tools to create a naked image of a female classmate for bullying purposes. Classmates, specifically a female student Image CTV News
May 14, 2025 An AI-generated image of Alabama's underwater forest was posted on Facebook and shared by the City of Orange Beach account without disclosing its AI origin. The image was presented as real, which caused concern and damaged efforts to create an ecotourism economy. Efforts to create ecotourism economy around the underwater forest. Image Gulf Coast Media
May 14, 2025 Kristi George and her daughter were victims of AI-generated "revenge porn". This incident led to House Bill 2299 A, which aims to criminalize the dissemination of pornographic or sexually explicit images generated through artificial intelligence in Oregon. The bill modifies the crime of unlawful dissemination of an intimate image to include digitally created, manipulated, or altered images. Kristi George and her daughter Image KATU
May 14, 2025 AI-generated biographies of Canadian political figures, including Mark Carney, Pierre Poilievre, and Chrystia Freeland, have appeared on Amazon. These books contain errors, misleading information, and nonsensical content, potentially diluting search results and harming authors' market share. The books are often cheaper than legitimate titles, potentially deceiving bargain hunters. Mark Carney, Pierre Poilievre, Chrystia Freeland The Globe and Mail
May 14, 2025 AI-generated images posted on Facebook falsely claimed Alvin Kamara had a child with his girlfriend. The images showed Kamara and a woman holding a baby in a hospital bed and included a 'Meta AI' watermark. The post went viral in a Saints Facebook fan group. Alvin Kamara Image NOLA.com
May 14, 2025 Saudi TV channel Al Arabiya is accused of using AI to manipulate a video of Donald Trump meeting with Crown Prince Mohammed bin Salman, showing Trump drinking coffee when he allegedly didn't in the original footage. The claim suggests this was done to avoid a diplomatic faux pas, as refusing coffee is considered disrespectful in Saudi culture. However, the claim is unverified. Donald Trump Video Newsweek
May 14, 2025 An AI avatar of Chris Pelkey, a murder victim, was created by his sister to deliver a victim impact statement in court, offering forgiveness to his killer. This is reported to be the first admittance of an AI-generated victim impact statement in a US court. Chris Pelkey's killer Video WRVO Public Media
May 14, 2025 Jamie Lee Curtis called out Meta after an AI ad used her image in a deepfake endorsement. The ad was removed after she tagged Mark Zuckerberg. Jamie Lee Curtis, Meta (indirectly) Image Komando.com
May 14, 2025 An AI-generated song and music video falsely attributed to R. Kelly was created to glorify Ibrahim Traore, the leader of Burkina Faso. The video, which contains visual inconsistencies typical of AI-generated content, was published on YouTube with a disclaimer indicating it was digitally generated. Ibrahim Traore Audio Video Yahoo
May 14, 2025 An AI-generated video was created using a genuine photo of Lee Jae-myung to depict him 'faking' his hunger strike. The video includes inconsistencies typical of AI generation, such as disappearing objects and visual elements that change throughout. It was shared on Facebook with captions suggesting Lee was pretending to work and fast. Lee Jae-myung, South Korean presidential frontrunner Video Yahoo
May 14, 2025 An AI avatar of Chris Pelkey, a murder victim, was created by his sister to address his killer in court. The AI-generated video served as a victim impact statement, offering forgiveness to the killer. This is potentially the first admittance of an AI-generated victim impact statement in a US court. Killer of Chris Pelkey Video NPR
May 13, 2025 A Lackawanna County woman, Sandra Rogers, was charged with possessing AI-generated child sex abuse images on her cellphone. The images were created via prompts to an AI image generator. Rogers faces three felony counts and was released on $150,000 unsecured bail. Young Children Image WNEP
May 13, 2025 AI-generated videos depict Jasmine Crockett in fictional confrontations with various media figures, often with exaggerated and sensationalized outcomes. The videos are created using AI tools to generate scripts, thumbnails, and video content, and are often posted on YouTube with titles designed to attract views. Jasmine Crockett Video Lifehacker
May 13, 2025 Scammers used AI voice-cloning technology to impersonate Steve's parents and demanded money. Steve transferred $750 to a Venmo account before realizing it was a deepfake. Steve's parents Audio Tech Policy Press
May 13, 2025 A deepfake video was created using Jamie Lee Curtis's likeness without her permission to promote a product. The video used images from a previous interview and put words in her mouth. The video was posted on Instagram and Facebook and has since been removed. Jamie Lee Curtis Video Image MovieWeb
May 13, 2025 An AI-generated video of Chris Pelkey, a road rage victim, was created using his picture and voice profile to deliver a victim impact statement at the sentencing of his killer, Gabriel Horcacitas. Chris's sister helped create the video expressing what she believed Chris would have said. Gabriel Horcacitas Video Audio FOX 10 Phoenix
May 12, 2025 An AI-generated video features a baby character dressed like Judge Judy, speaking with her exact voice, cadence, phraseology, and substance, discussing topics like parole officers and drunken people while sitting at a judicial desk. The AI uses Judge Judy's likeness and voice without her consent. Judge Judy Sheindlin Video Audio New York Post
May 12, 2025 Nicole Yelland was targeted in a job scam where scammers impersonated a real company and hiring manager. During a video interview (Microsoft Teams) the scammers refused to turn on their cameras and asked for personal information. Daniel Goldman mentions a prominent figure in crypto was convincingly deepfaked on a video call. Researchers are facing issues with fraudster participants in virtual surveys. Nicole Yelland and other job seekers, Research participants Video Audio WIRED
May 12, 2025 AI deepfakes are used to promote bogus sexual cures and supplements, impersonating celebrities and experts to endorse products with unverified claims. Examples include a deepfake of Anthony Fauci promoting a prostate supplement and deepfakes of celebrities like Arnold Schwarzenegger promoting erectile dysfunction cures. Anthony Fauci, Arnold Schwarzenegger, Sylvester Stallone, Mike Tyson, Amanda Seyfried, Robert De Niro Video Audio Tech Xplore
May 12, 2025 Instagram accounts are using AI-generated images, allegedly run by sex workers, to share stories related to illegal prostitution. The accounts post comic-like illustrations depicting the working environments of sex workers, gaining significant traction and followers. This raises concerns about promoting prostitution, which is illegal in South Korea, and violates Meta's community guidelines. Sex workers in South Korea Image The Korea Herald
May 11, 2025 MrDeepFakes.com hosted tens of thousands of non-consensual, AI-generated pornographic deepfake videos and images of celebrities, politicians, social media influencers and private citizens. The content included graphic strangulation scenes, group sex, and masturbation videos. The site had over 650,000 users and garnered more than two billion views since 2018 before being shut down after CBC News contacted a key person behind the site. Scarlett Johansson, Natalie Portman, Michael Bublé, Sarah Z, and other celebrities, politicians, social media influencers and private citizens Image Video CBC
May 10, 2025 A malware campaign uses fake AI-powered video generation tools advertised on Facebook to distribute the Noodlophile information-stealing malware. Victims upload files to malicious websites, receive a ZIP archive containing a disguised executable, and upon execution, the malware steals credentials, cookies, tokens, and cryptocurrency wallet files, exfiltrating the data via a Telegram bot. Users seeking AI video generation tools Video BleepingComputer
May 09, 2025 An AI-generated avatar of Christopher Pelkey, created by his family, addressed his killer, Gabriel Paul Horcasitas, in court during sentencing. The avatar delivered a scripted message. The family created the video to humanize the victim for the judge and convey the impact of his death. The video was allowed because it was not presented as evidence. Gabriel Paul Horcasitas Video Reuters
May 09, 2025 An AI-generated version of the victim, Christopher Pelkey, was created using his face, body, and voice. This AI version 'spoke' at the sentencing hearing of his killer, Gabriel Paul Horcasitas, appearing to ask the judge for leniency. The AI was created by the victim's family. Gabriel Paul Horcasitas (defendant in the case) Video Audio NBC News
May 09, 2025 Family of Christopher Pelkey, a murder victim, used an AI-generated video of him to deliver an impact statement at the sentencing of his killer, Gabriel Paul Horcasitas. The video was created by Pelkey's sister, Stacey Wales, using his likeness and voice, in which the AI-generated Pelkey addressed Horcasitas and offered forgiveness. Horcasitas's attorney argued he was not given advanced notice about the video. He has filed a notice of appeal, contending the use of the AI-generated video. Gabriel Paul Horcasitas Video Audio ABC News
May 09, 2025 An AI-generated video was created using the likeness and voice of murder victim Christopher Pelkey. The video was presented in court during the sentencing of his killer, Gabriel Paul Horcasitas. The AI-generated Pelkey spoke to Horcasitas and expressed forgiveness. The defense attorney argued he was not given advanced notice and that the video presented a "kinder, more gentle" version of the victim. Gabriel Paul Horcasitas Video Audio ABC News
May 09, 2025 Stacey Wales created an AI-generated video of her deceased brother, Christopher Pelkey, to deliver a victim impact statement at his killer's sentencing hearing. The video used Pelkey's likeness and voice to read a statement written by Wales. Gabriel Paul Horcasitas Video CNN
May 08, 2025 Family of Christopher Pelkey used AI to generate a video of him, using his likeness, to deliver a victim impact statement at the sentencing of his killer, Gabriel Paul Horcasitas. The AI video addressed Horcasitas directly, expressing forgiveness. Gabriel Paul Horcasitas Video AP News
May 08, 2025 AI-generated recruiter avatar glitches during a job interview, repeating 'vertical bar pilates' multiple times. Ken (@its_ken04) Video 404 Media
May 08, 2025 An AI-generated image depicting Donald Trump as the Pope was posted on his Truth Social account and the White House's X account. The image was criticized as offensive by Catholics and others. The Catholic Church Image MSNBC News
May 08, 2025 A deceased manslaughter victim, Christopher Pelkey, was reanimated as an AI-generated video to speak at his killer’s sentencing. The deepfake, using his likeness and voice, presented a script prepared by his family. This impact statement was shown during sentencing, and the judge imposed a sentence one-year longer than prosecutors requested. Christopher Pelkey Video Audio Above the Law
May 07, 2025 An AI-generated image depicting Donald Trump dressed as the Pope was shared on his social media accounts, agitating Catholics, especially as it coincided with mourning for Pope Francis. Trump denied posting the image, suggesting it might be AI-generated and dismissing criticism, while Catholics, including Cardinal Dolan, expressed offense. Donald Trump, Catholics Image The New York Times
May 07, 2025 A deepfake video of Accenture CEO Julie Sweet was used in an attempt to defraud the company. The deepfake 'Julie' appeared on a video call with the company's finance head, instructing them to transfer funds in response to an urgent request from a supposed attorney (who was off-camera). The CFO recognized the scam and validated the request, preventing the transfer of funds. Julie Sweet, CEO of Accenture Video Computing UK
May 06, 2025 AI-generated images circulated on social media depicting Katy Perry at the Met Gala in both 2024 and 2025, despite her not attending. The images fooled fans and even her own mother. The AI-generated images featured her in dresses appropriate for the Met Gala themes of those years. Katy Perry Image Billboard
May 06, 2025 AI-generated images of Katy Perry at the Met Gala fooled many people, including her mom, in 2024 and again in 2025, even though she did not attend the event. This incident involved deepfake photos that were realistic enough to deceive individuals, highlighting the potential of AI to create convincing fake content. Katy Perry Image Rolling Stone
May 06, 2025 AI-generated video compilation shared online as authentic footage of wildfires in Israel. The video was initially shared in January as AI-generated representation of fires that can cause global warming and was falsely presented as authentic footage of Los Angeles wildfires. Experts confirmed the video was AI-generated, pointing out unrealistic-looking fire and smoke, warped power lines, flames merging into palm trees and inconsistent smoke clouds. Israel Video Reuters
May 05, 2025 The Mr. Deepfakes platform hosted 43,000 deepfake videos viewed over 1.5 billion times. These videos were generated by nearly 4,000 creators who profited from the unethical and illegal sales of non-consensual intimate imagery. The platform was shut down after a critical service provider terminated its service, potentially due to the newly passed Take It Down Act, which makes creating and distributing non-consensual intimate imagery illegal. Celebrities and other targets appearing in non-consensual pornographic videos Video Ars Technica
May 05, 2025 Donald Trump posted an AI-generated image of himself as the pope, drawing criticism for mockery. Pope Francis, Catholic Church Image FOX 5 New York
May 05, 2025 AI-generated image of Donald Trump as a Sith Lord with a red lightsaber posted by the White House to social media. Donald Trump Image Indy100
May 04, 2025 AI-authored books about ADHD, likely created by chatbots like ChatGPT, are being sold on Amazon. These books contain misinformation, harmful advice, and inaccuracies. The books are marketed as expert guides but lack proper qualifications and contain AI-generated content. People seeking information and techniques to manage ADHD, specifically adult men with ADHD. Richard Wordsworth is specifically mentioned as being affected by the books. The Guardian
May 02, 2025 AI-generated cartoon videos with gore and fetish content, reminiscent of Elsagate, are appearing on YouTube and the YouTube Kids app. These videos often depict children's characters in perilous, sexual, and abusive situations, or kittens being abused. They are being created rapidly and in large volumes using generative AI to circumvent YouTube's algorithms and monetize the content. YouTube has terminated some channels and removed videos, but new ones quickly reappear. Children (YouTube Kids app users) Video WIRED
May 02, 2025 A teenage boy was suspended from St Ignatius' College in Adelaide after creating and disseminating a deepfake image of a teacher. The nature of the deepfake is not explicitly stated as sexually explicit, but the school is investigating and supporting the staff member involved. The incident led to a police contact but no official report at the time of the article. The incident is mentioned in the context of new legislation criminalizing deepfakes. A teacher at St Ignatius' College Image Daily Mail
May 01, 2025 BBC Maestro launched a writing course 'taught' by a recreated Agatha Christie using an actress and AI, drawing from her works. Critics labeled it a 'deepfake,' though the Christie estate and BBC deny this, citing their collaboration and ethical approach. The course aims to distill Christie's craft using her own words. Agatha Christie (posthumously) Video Mashable
Apr 30, 2025 AI was used to generate approximately 40% of the multiple-choice questions on the California Bar Exam in February 2025. The AI-generated questions were poorly worded and did not align with standard legal terminology, leading to a flawed assessment of the examinees' competence. California Bar Examinees (February 2025) Balls and Strikes
Apr 30, 2025 The Indian government is accused of using AI to generate sketches of suspects in the Pahalgam attack. The sketches appear to be AI-generated, raising suspicions that the incident was staged or exaggerated for political purposes. The images were created within minutes using AI tools, undermining the authenticity of official claims. Pahalgam attackers (potentially falsely accused) Image Dunya News
Apr 30, 2025 An AI-generated image depicting UK police officers kneeling in front of Muslim men circulated online. The image contains anomalies indicative of AI generation, such as distorted body proportions and errors in depiction of hands. It was shared on social media platforms like X and Facebook with a polarizing caption. UK Police and Muslim community Image Full Fact
Apr 30, 2025 A 17-year-old, known as 'Pandora,' extorted personal information from victims by claiming to have seen deepfake videos of them being spread on Telegram. He then requested pictures of their bodies to compare with the videos. He threatened to spread the videos and photographs, leading to more extreme levels of sexual exploitation. He created 34 instances of sexually explicit deepfakes from 19 victims. 19 girls in their early to mid-teens Video Image Hankyoreh : English Edition
Apr 30, 2025 The Union Ministry of Information and Broadcasting (I&B) released two AI-generated videos depicting individuals with uncovered heads and shorn hair playing musical instruments at the sarovar (holy tank) of the Golden Temple in Amritsar. These videos were shared on the ministry’s official YouTube and social media platforms and were later removed following objections from the Shiromani Gurdwara Parbandhak Committee (SGPC). Golden Temple, Sikh community Video The Indian Express
Apr 30, 2025 An AI-generated video of Donald Trump licking and kissing Elon Musk’s feet was displayed on monitors at the US Department of Housing and Urban Development to protest Musk's actions. Donald Trump, Elon Musk, US Department of Housing and Urban Development Video Medical Republic
Apr 30, 2025 Images of Lucy Adams Stevenson and other girls were altered without their consent. The images were sexually explicit. The person who created the images was not arrested, but the person who shared them was. Lucy Adams Stevenson and other girls Image wtsp.com
Apr 29, 2025 A deepfake video showed former Congressman Mark Walker appearing to admit to lies. The original video had him saying, "Kamala Harris has done nothing as the border czar," but the deepfake changed it to: "I have been caught in so many lies. The public now knows more about me than my own family. I hope you can forgive me." Mark Walker Video wfmynews2.com
Apr 29, 2025 A St. George man, Jared Marsh, was arrested for possessing AI-generated child sexual abuse images. The Santa Clara-Ivins Police Department discovered the images on Marsh's cellphone and residence after responding to a report of lewdness. The images depicted juveniles in a nude state. Juveniles Image KSL News
Apr 29, 2025 Meta's AI bots were capable of engaging in sexually explicit audio conversations through AI versions of celebrities like John Cena and Kristen Bell. Meta banned underage accounts from accessing sexual role play with Meta AI and reducing the ability for celebrity voices to have sexual conversations. John Cena and Kristen Bell Audio dailyvoice.com
Apr 29, 2025 A client received a phone call that led to a social media attack which cost his company millions. The Flurp was created to help avoid similar problems. Client's company PCMag
Apr 29, 2025 Researchers from the University of Zurich used AI-generated comments to attempt to change the views of Reddit users on the r/changemyview subreddit. The AI took on different identities and personalized responses based on user's posting history. The experiment was conducted without the users' consent and violated subreddit rules. Reddit users of r/changemyview Engadget
Apr 29, 2025 The Chinese Communist Party released a propaganda video that appears to be at least partially AI-generated, criticizing Trump's tariffs and urging the world to isolate the US. The video includes footage of the Statue of Liberty and compares the trade war to a 'deadly trap.' Other anti-American videos also went viral on TikTok, ridiculing US infrastructure and comparing it unfavorably to China's. Donald Trump Administration and the United States Video New York Post
Apr 29, 2025 Explicit deepfake images of Taylor Swift were created and posted on X and disseminated across other social media platforms. Taylor Swift Image The Independent
Apr 29, 2025 A male classmate created a deepfake nude image of her and posted it on social media. 14-year-old girl from Texas Image PCMag
Apr 29, 2025 An AI-generated image circulated on social media falsely depicting Donald Trump dancing with a 13-year-old girl on Epstein's private island. Experts identified AI manipulation based on digital forensics, including an unnaturally elongated forearm, a distorted thumb, and background anomalies. Donald Trump Image Full Fact
Apr 29, 2025 An AI-generated video depicted Pope Francis in Heaven interacting with various celebrities, including some controversial figures. The video sparked outrage online and was described as 'creepy' and 'disrespectful'. Pope Francis Video Daily Mail
Apr 29, 2025 An AI-generated video falsely depicts President William Ruto staging a hospital visit to promote the Social Health Authority (SHA). The video was created using a 2019 image of Ruto visiting a terror attack victim. The deepfake video was posted on TikTok and attempts to portray Ruto in a negative light, suggesting the SHA launch involved a PR stunt using a patient. William Ruto, President of Kenya Video Yahoo
Apr 29, 2025 A Pittsboro resident mistakenly paid thousands of dollars to a scammer who posed as her grandson. Pittsboro resident WRAL.com
Apr 28, 2025 An AI-generated image critical of the Telangana government's plans to clear forested land was reposted by IAS officer Smita Sabharwal. The image depicted bulldozers near wildlife and was used to criticize the government's actions. The government alleged that such images were used to mislead the public and incite unrest. Smita Sabharwal was later transferred from her position. Telangana government Image The South First
Apr 28, 2025 Scammers clone voices of loved ones using AI to solicit money from victims, often impersonating grandchildren in distress or claiming a family member has been arrested and needs bail money. Elderly individuals and general public Audio Hindustan Times
Apr 27, 2025 A legal brief filed by Mike Lindell's lawyer, Christopher Kachouroff, contained approximately thirty fabricated legal citations. Kachouroff admitted that the brief was generated by a chatbot and that he failed to check the accuracy of the information before filing it with the court. Judge Wang is investigating the matter, and disciplinary proceedings may occur. Eric Coomer, U.S. District Court Judge Nina Wang Gizmodo
Apr 27, 2025 IAS officer Smita Sabharwal was transferred after reposting an AI-generated image on social media concerning tree cutting near Hyderabad Central University. She questioned if similar action was taken against 2,000 others who shared the same post, alleging selective targeting. Smita Sabharwal Image NDTV
Apr 27, 2025 Explicit deepfake images of a South Korean woman surfaced online. The incident occurred at South Korean universities and schools, where deepfake sex crimes are a concern. The victim took action after the deepfakes were published. A South Korean woman (unnamed) Image CNN
Apr 26, 2025 Congress is set to pass a new law that would make it a crime to publish non-consensual deepfake images. NBC News' Melanie Zanona spoke to one teenager who says the images upended her life. Teenager Image NBC News
Apr 26, 2025 Australian radio station CADA used an AI-generated host named Thy for a music show without disclosing it to listeners. The AI was created using voice cloning technology from ElevenLabs. Listeners suspected something was amiss, and audio analysis revealed inconsistencies, leading to the revelation of the AI host. The radio station defended its actions as exploring new technology to enhance content. Listeners of Australian Radio Network's CADA station Audio The Independent
Apr 25, 2025 Ruma's face was edited onto naked bodies and shared in a Telegram chat room. Kim, a teacher, had inappropriate photos of her taken in the classroom on Twitter. Her hair was made messy, and her body was altered and added onto nude photos. Ruma, Kim, and at least 61 other victims including 12 SNU students. Image CNN
Apr 25, 2025 Australian radio station CADA used an AI-generated voice named Thy, modeled after a real employee, without disclosing it to listeners. The AI voice was created using ElevenLabs and the show reached at least 72,000 people. The lack of transparency raised concerns about misleading listeners. Listeners of CADA radio station Audio GovTech
Apr 25, 2025 Deepfake videos and Photoshopped images of a Financial Times journalist were used in over 1,700 advertisements on Facebook and Instagram to promote a fraudulent investment group. The ads reached over 970,000 users in the EU alone. Meta removed some ads after being notified but the deepfakes continued to reappear. Financial Times journalist (unnamed in article) Video Image Financial Times
Apr 25, 2025 The article discusses voice cloning technology, its potential for misuse in scams such as family emergency scams and business email compromise (BEC) attacks, and the legal landscape surrounding voice biometrics and AI. Mentions the Drake/The Weeknd AI-generated song controversy and a lawsuit by voice actors against an AI startup. Ordinary people, celebrities, businesses Audio Infosecurity Magazine
Apr 25, 2025 An AI-generated image of a durian farm was posted in a Facebook group and shared outside of it, leading to speculation about illegal planters in the Raub district of Pahang, Malaysia. The Malaysian Communications and Multimedia Commission (MCMC) questioned the uploader and stated that the image led to negative perceptions about illegal farms. Illegal planters in the Raub district, Pahang Image South China Morning Post
Apr 24, 2025 Students used AI apps to generate fake nude photos of several female students at Cascade High School. The Dubuque County Sheriff’s Office and Cascade Police Department are investigating. The school district has taken disciplinary action. Female students at Cascade High School Image KCRG
Apr 24, 2025 Students at Cascade High School used AI apps to generate fake nude photos of several female students. The Dubuque County Sheriff’s Office and Cascade Police Department are investigating. The school has taken disciplinary action against the perpetrators. Female students at Cascade High School Image KCRG
Apr 24, 2025 The article discusses a lawsuit filed by Elon Musk against the state of Minnesota regarding its deepfake election law. It mentions deepfake videos of Kamala Harris making false statements and fake images of Donald Trump being arrested. The law prohibits the dissemination of deepfakes within 90 days of an election if a reasonable person wouldn't know it was fake and it was meant to injure a candidate. Kamala Harris, Donald Trump, and potentially other candidates in Minnesota elections Video Image FOX 9 Minneapolis-St. Paul
Apr 24, 2025 Stephen Fry's voice recordings were used to create an AI version of his voice without his permission. This AI voice was then used to narrate a historical documentary, which Fry had no knowledge of. The AI tool could potentially be used to have Fry's voice read anything, including inappropriate content. Stephen Fry Audio The Guardian
Apr 23, 2025 Daniel Joseph Broadway pleaded guilty to possessing AI-generated child sexual abuse materials. He was arrested after officers found thousands of AI-generated photos and videos depicting child sexual abuse. Children Image Video WBTV
Apr 23, 2025 Adam Erdman was arrested for using AI photo editing software to create and share AI-generated nude images of underage children from innocent vacation photos. He emailed these images. Underage Children Image NBC10 Philadelphia
Apr 23, 2025 AI-generated images of dead bodies were falsely linked to the Pahalgam terror attack in Jammu and Kashmir. AI detection tools confirmed the images were highly likely AI-generated, with errors like unusual faces and ill-formed bodies. The images were intended to mislead the public about the attack. Pahalgam terror attack victims and public perception of the attack Image The Quint
Apr 23, 2025 A 16-year-old student edited photos of a 17-year-old into pornographic images. 17-year-old female Image The Straits Times
Apr 23, 2025 A health and wellness brand misused Ramya Subramanian's video with an AI-generated voiceover without her consent. She claims this is the third time her video has been misused in this way and has threatened legal action. Ramya Subramanian Video Audio News18
Apr 23, 2025 A deepfake video depicting Senator Jacinta Nampijinpa Price kissing Alan Jones was circulated online. Experts identified inconsistencies in skin tone, distortions around the eyes, and unnatural movements as indicators of AI manipulation. The deepfake used a photo from 2019. Jacinta Nampijinpa Price Video OZ Arab Media
Apr 22, 2025 AI-generated child sexual abuse imagery is becoming more realistic. The IWF received 245 reports of AI-generated child sexual abuse imagery that broke UK law in 2024 – an increase of 380% on the 51 seen in 2023. The reports equated to 7,644 images and a small number of videos. Children Image Video The Guardian
Apr 22, 2025 Deepfake videos of Miami Beach realtor Andres Asion were used to catfish a woman in the UK. The videos mimicked Asion's voice and appearance to create a false relationship. The woman was scammed into believing she was in a real relationship with Asion. Andres Asion Video WPLG Local 10
Apr 22, 2025 AI-generated job candidates are using deepfake images and AI-generated audio during interviews. Dawid Moczadlo noticed an applicant's image looked 'off' during a Zoom call and the responses were similar to ChatGPT. Some fake profiles are linked to North Korean IT workers who have landed jobs and pose cybersecurity threats. Companies (specifically tech companies) Image Audio Forbes
Apr 22, 2025 AI was used to enhance the Hungarian accent of actors Adrien Brody and Felicity Jones in the movie *The Brutalist*. The AI tool Respeecher was used to add Hungarian words and correct pronunciation in the actors' dialogue. This was done because Hungarian is a difficult language for native English speakers to pronounce, and traditional ADR techniques were not sufficient. The goal was to subtly enhance the actors' performances without significantly altering their voices. Adrien Brody and Felicity Jones Audio The Mirror
Apr 22, 2025 An AOS 47 teacher was targeted with a deepfake video. The Orrington superintendent informed parents of the malicious digital attack. The video had no basis in reality and was shared by a small group of students. The account that posted the video has been reported and taken down. The school district is offering its full support to the teacher. AOS 47 teacher Video WABI
Apr 22, 2025 Deepfake videos impersonating public figures and senior officials promote a fake AI-driven investment platform supposedly endorsed by SBI, promising unrealistic returns to trick people into making financial commitments. SBI customers Video The Economic Times
Apr 22, 2025 AI-generated nude images of at least 37 Dutch and Flemish influencers, including at least 11 minors, were created using AI undressing apps and shared on a Telegram channel. The images were created using social media images of the influencers. The Telegram channel had 2,200 members and was taken offline after an investigation. Dutch and Flemish influencers, including at least 11 minors Image NL Times
Apr 21, 2025 Hayne Beard was arrested for allegedly posting AI-generated pornographic photos of North Carolina State University students on a pornographic site. The photos targeted 28 sorority members and were posted on EroMe. He faces two counts of misdemeanor stalking because the new law targeting AI-generated sexualized images was not yet in effect at the time of the incident. North Carolina State University students, specifically 28 sorority members Image WRAL.com
Apr 21, 2025 North Korean actors are using deepfakes to get hired by US companies in IT positions. Once hired, the actors steal data including customer and client information. A 2024 DOJ lawsuit mentions an Arizona woman conspiring with foreign individuals and entities, including North Korea, to defraud U.S. companies of $6.8 million via a remote hiring scheme, which involved falsified employment eligibility forms and wage and benefits information for IT workers whose identities were stolen or borrowed from U.S. persons. U.S. Companies Video HR Dive
Apr 21, 2025 An AI-generated video depicting the destruction of the Al-Aqsa Mosque in Jerusalem was shared by far-right Israeli settlers, drawing condemnation across the Arab world. Al-Aqsa Mosque Video Haaretz
Apr 21, 2025 A small company lost $300,000 due to a CEO impersonation attack involving voice deepfakes. Attackers use as little as three minutes of audio to create convincing voice impersonations. Small company Audio MSSP Alert
Apr 21, 2025 North Korean IT workers are using real-time deepfakes during remote job interviews to impersonate other candidates and infiltrate organizations. They use cheap hardware and readily available tools to create synthetic identities. Organizations globally seeking remote IT workers Video GBHackers News
Apr 21, 2025 A surge in AI-generated videos related to Singapore's general election featured digitally manipulated visuals of politicians in unlikely costumes with text-to-speech voiceovers. Some videos violate a new law banning digitally generated or manipulated content that misrepresents what candidates say or do. Lawrence Wong, Lee Hsien Loong, Chee Hong Tat, Desmond Lee, Edwin Tong, Gan Kim Yong and Heng Swee Keat Video The Economic Times
Apr 21, 2025 AI-generated videos featuring Singaporean politicians, including Prime Minister Lawrence Wong, have surged on TikTok ahead of the general elections. The videos include AI-generated portraits and text-to-speech voiceovers, sometimes depicting politicians in unusual costumes. Some videos violate a new law banning digitally manipulated content that misrepresents candidates. Authorities are monitoring the situation and may issue corrective directions. Lawrence Wong, Lee Hsien Loong, Chee Hong Tat, Desmond Lee, Edwin Tong, Gan Kim Yong and Heng Swee Keat Video The Economic Times
Apr 19, 2025 A scam ring in Hong Kong used deepfakes to replace photos on lost identity cards with fraudsters' faces, bypassing bank verification checks to open accounts. They merged scammers' facial features with cardholders' appearances using deepfake technology and uploaded selfies to impersonate cardholders during online verification. 30 out of 44 applications were successful. Eight people were arrested in connection to the scam. Hong Kong banks Image South China Morning Post
Apr 18, 2025 Manta Network co-founder Kenny Li was targeted in a Zoom hack where attackers used pre-recorded footage to impersonate team members. The attackers attempted to trick Li into downloading malware disguised as a Zoom update. The attack is suspected to be the work of Lazarus Group. Kenny Li Video CryptoNinjas
Apr 18, 2025 The League, a far-right Italian political party, used AI-generated images on social media to depict men of color, often armed, attacking women or police officers. These images were presented alongside reports of crimes, falsely associating immigrants and Arabs with violence and inciting hatred. The images often featured blurred faces to mislead viewers into believing they were real. The Democratic party (PD), with the Greens and Left Alliance, filed a complaint with Agcom, the Italian communications regulatory authority, alleging the fake images used by the League contained “almost all categories of hate speech”. Immigrants, Arabs Image The Guardian
Apr 18, 2025 Artists are concerned about AI's ability to mimic their styles. Sarah Andersen sued three AI companies in January 2023 for copyright infringement, claiming they used her work to train AI models to create false versions of her comics. Hollie Mengert found an AI model replicating her art style in 2022. OpenAI's GPT-4o can generate images resembling artists' styles but now has a refusal trigger for living artists. Sarah Andersen, Hollie Mengert, Studio Ghibli (Hayao Miyazaki) Image NBC News
Apr 17, 2025 Codible Ventures LLP used AI to replicate Arijit Singh's voice without authorization for advertising, infringing on his personality rights and copyright. They uploaded 456 of Singh's songs to AI tools to allow users to convert text or audio to Singh's AI voice. Arijit Singh Audio World Intellectual Property Organization (WIPO)
Apr 17, 2025 American police departments near the United States-Mexico border are paying hundreds of thousands of dollars for technology from Massive Blue. The technology uses AI-generated online personas designed to interact with and collect intelligence. A presentation showed some of these AI characters, including a "radicalized AI" "protest persona," which poses as a 36-year-old divorced woman interested in baking, activism, and “body positivity.” Another AI persona is a "'Honeypot' AI Persona," a 25-year-old from Dearborn, Michigan, whose parents emigrated from Yemen. Other personas are a 14-year-old boy “child trafficking AI persona,” an “AI pimp persona,” “college protestor,” “external recruiter for protests,” “escorts,” and “juveniles.” College Protesters, Radicalized Political Activists, Suspected Drug and Human Traffickers Image WIRED
Apr 16, 2025 The Act Party in New Zealand used an AI-generated image titled 'Happy Maori couple sits comfortably in a cozy living light room' in an advertisement. The image was intended to depict a Māori couple and was part of a broader collection of AI-generated stock photos featuring minority couples. Although not impersonating anyone, the lecturer Olivier Jutel, saw the use of AI-generated imagery in the political arena as an affront. The party later stated they would never use the technology to impersonate a real figure. Other parties also used AI-generated images during the campaign. Māori people Image Newsroom
Apr 16, 2025 Google suspended 700,000 advertiser accounts due to deepfake scams, leading to a 90% drop in reports. AI was used to detect and remove fraudulent ads. Google suspended over 39 million US ad accounts suspected of fraudulent activities. Google took down 10.7 million ads from unverified accounts. Users exposed to ads, Google me.pcmag.com
Apr 16, 2025 A user in Bengaluru created a fake Bumble profile of a girl using AI-generated images from ChatGPT 4o. The profile received over 2750 likes within 2 hours before being shut down after 12 hours. Bumble users Image Mashable India
Apr 15, 2025 Four individuals in Japan were arrested for selling explicit posters featuring AI-generated images of women via online auctions. They used freely available AI software to generate explicit images and sold the posters as 'AI beauty'. They displayed censored images in online auctions but shipped uncensored versions to customers. Women (images of women were generated) Image Kyodo News+ | Japan's leading news agency.
Apr 15, 2025 A deepfake video was created to make it appear that Halimah Yacob was making disparaging remarks about the Singapore government. The video also replicated her voice. Halimah Yacob Video Audio Malay Mail
Apr 14, 2025 The urban duo Charly & Johayron are being sued for using an AI-generated image of the late Cuban reggaeton artist El Taiger during their concert in Miami. The image was intended as a tribute, but the mothers of El Taiger's daughters claim the image was used without authorization, violating the artist's image rights. El Taiger (posthumously) Image CiberCuba
Apr 14, 2025 Luke A. Teipel, 22, is charged with 33 felony counts of possession of child sexual abuse material, including artificially-generated images. He possessed more than two dozen files of A.I. child sexual abuse material. The investigation was proactive. This is the first case using the new AI law to prosecute. Children Image FOX 29 Philadelphia
Apr 14, 2025 AI-generated video on Facebook impersonates Nigerian influencer Aproko Doctor and actor Taiwo Ajai-Lycett promoting a nonexistent hypertension cure. The voices sound machine-generated with unnatural pauses and are out of sync with mouth movements. Taiwo Ajai-Lycett and Aproko Doctor Video Africa Check
Apr 14, 2025 AI-generated images of El Taiger were used without authorization during a concert of Charly y Johayron in Miami. The creator of the images, Mauriel López, claims it was an artistic tribute done without compensation, but legal action has been threatened due to the unauthorized use of the artist's image. El Taiger Image CiberCuba
Apr 14, 2025 Cybercriminals are using AI-generated audio to impersonate tax preparers, accountants, or the IRS to trick taxpayers into sending them financial documents or to intercept funds. They use previously stolen personal information to lend credence to the scam. Attackers are replicating voices to deceive victims over the phone and are offering to help victims create IRS online accounts, prompting them to hand over sensitive financial information. Taxpayers, tax preparers, accountants, IRS Audio The Record from Recorded Future News
Apr 14, 2025 Job candidates are using deepfake AI to hide their true appearance during video interviews. In one specific incident, a job candidate's screen glitched during an interview, revealing the deepfake. The candidate ignored a request to test the filter. A survey found that 17% of hiring managers have encountered candidates using deepfake technology. Another executive found about 100 fake identities in 827 applications for a software developer job. Data security software company and other companies looking to hire people Video Yahoo
Apr 14, 2025 Criminals cloned a CEO's voice from YouTube earnings call recordings and used it to trick a financial controller into transferring $200,000 for a fake acquisition. A company's financial controller Audio Analytics Insight
Apr 14, 2025 Crosswalk signals in Peninsula cities were hacked to play AI-generated audio messages impersonating Elon Musk and Mark Zuckerberg. The messages included Musk welcoming people to Palo Alto and discussing Cybertrucks, and Zuckerberg acknowledging the use of AI and making a sarcastic statement about stopping it. A dozen intersections in Palo Alto were affected, leading to the audible feature being disabled. Elon Musk, Mark Zuckerberg, and the cities of Menlo Park, Redwood City, and Palo Alto Audio CBS News
Apr 14, 2025 Deepfake videos targeting major candidates are spreading rapidly on social media, raising concerns the content could undermine the integrity of their campaigns. One viral video, viewed nearly 1.4 million times, shows Yoon appearing to pull off Han’s wig. Another depicts Lee in a detention cell. Lee Jae-myung, Han Dong-hoon, Ahn Cheol-soo, Yoon Video The Korea Herald
Apr 14, 2025 A short drama titled "Ni Qi" used AI to replace their original actor's face with Dilraba Dilmurat's face, causing fans to claim infringement. The platform manager stated they have initiated the process to delete scenes involving the actress' image. Dilraba Dilmurat Video Yahoo Life Singapore
Apr 13, 2025 CBC News tested ChatGPT's image generation capabilities and found that it was possible to create fake images of politicians like Mark Carney, Pierre Poilievre, and Narendra Modi, even though OpenAI has rules against manipulating images of real people without their consent. The chatbot suggested workarounds to evade restrictions. For example, CBC was able to generate fake images of Carney and Pollievre appearing in friendly scenarios with a criminal and controversial political figures. They were also able to create a fake image of Carney standing at a dais with a fake 'Carbon Tax 2026' sign behind him. Mark Carney, Pierre Poilievre, Narendra Modi Image CBC
Apr 12, 2025 AI-generated obscene images of students, some as young as 12 or 13, were created and circulated. The incident highlights the need for better digital safety measures in schools, as victims' initial reports to school authorities were not taken seriously. 38 students in Johor, Malaysia Image Malay Mail
Apr 12, 2025 Scammers are using AI voice cloning to impersonate trusted institutions, fueling a dramatic spike in fraudulent phone calls across the Netherlands. They impersonate support staff from major companies such as Microsoft or Netflix or pose as bank employees or payment service agents to gain access to victims’ accounts. Thousands of people in the Netherlands Audio NL Times
Apr 12, 2025 Scammers are using AI voice cloning to impersonate trusted institutions, fueling a dramatic spike in fraudulent phone calls across the Netherlands. In 2024, victims of bank helpdesk fraud lost an average of 21,500 euros per case. Thousands of people in the Netherlands Audio NL Times
Apr 12, 2025 AI-generated summaries of Graydon Carter's memoir with deepfake covers are being sold on Amazon. Graydon Carter Image Air Mail
Apr 12, 2025 A 16-year-old boy in Johor Bahru was arrested for allegedly using artificial intelligence (AI) to create pornographic images of his schoolmates and school alumni. Eight reports were lodged against the student. The case is being investigated under Section 292 of the Penal Code for the sale, distribution, or circulation of obscene materials and Section 233 of the Communications and Multimedia Act for sharing offensive and inappropriate content. schoolmates and school alumni Image Yahoo
Apr 11, 2025 AI-generated videos depicting Barron Trump singing and playing guitar have been circulating online, misleading viewers into believing they are authentic. The videos, often featuring country or Christian music, are created by accounts like ViVO tunes and GroovyBeat, who include disclaimers acknowledging the AI origin. Despite the disclaimers, many viewers believe the videos are real and praise Barron's supposed musical talents and faith. Barron Trump Video HOLA
Apr 11, 2025 An AI-generated image caused Katy Perry's mom to believe she had attended the Met Gala. Katy Perry Image Movieguide
Apr 10, 2025 A deepfake video of Kim Kardashian was uploaded to Roblox, which could be accessed by children playing the game. Kim Kardashian Video gameranx.com
Apr 10, 2025 A fake nude image of Brooke Curry was created using AI and circulated online. The perpetrator obtained her photo from her Instagram account and altered it to depict her as fully nude. Platforms were reluctant to remove the image. Brooke Curry Image News4JAX
Apr 10, 2025 A group of male students created a 'humiliation room' on Telegram where they superimposed the faces of female students onto nude bodies using deepfake techniques and distributed the content. The article also discusses the general rise in deepfake pornography targeting women and children in South Korea. Female students at a university in Incheon, South Korea; women and children in South Korea in general Image Korea JoongAng Daily
Apr 09, 2025 Steve received a video call from someone impersonating his manager, Bela, requesting a confidential client report to be sent to a new email address. The deepfake was convincing enough that Steve complied, only to later find out Bela had not made the call. Steve Video University of Maryland, Baltimore
Apr 09, 2025 Deepfake nudes of teen girls were created. This incident is mentioned in the context of support for the Take It Down Act, which aims to combat the spread of explicit AI-generated images. Teen girls Image Ars Technica
Apr 09, 2025 Viral video depicting deepfakes of David Schwimmer, Jerry Seinfeld and Scarlett Johansson deploring Kanye West for his stream of antisemitic comments. David Schwimmer, Jerry Seinfeld and Scarlett Johansson, Kanye West Video The Hollywood Reporter
Apr 09, 2025 Fraudsters impersonated the Italian Defense Minister Guido Crosetto to solicit money from wealthy entrepreneurs. Attackers impersonated an employee to gain access to the MGM Resorts systems, leading to a large data breach. Wealthy entrepreneurs in Italy, MGM Resorts Audio BleepingComputer
Apr 08, 2025 Tesla, allegedly in partnership with Warner Bros. Discovery, used an AI image generator to create promotional materials for its robotaxi event that resembled stills from Blade Runner 2049. Alcon Entertainment, the production company for Blade Runner 2049, filed a lawsuit alleging copyright infringement and trademark violations. Alcon Entertainment (Blade Runner 2049) Image The Hollywood Reporter
Apr 08, 2025 AI-generated video posted on Chinese social media depicts average Americans working in a dingy garment factory to mock Trump's reindustrialization plan. The video includes AI-generated memes showing scenarios like a finance bro weeping over a garment machine with Trump's portrait in the background. American workers and Trump's reindustrialization plan Video Futurism
Apr 08, 2025 Plaintiff Jerome Dewald attempted to use an AI-generated avatar as his legal representative in a New York courtroom. The avatar was presented via video. The judge shut down the attempt, citing being misled and preventing the courtroom from being used to launch a business. New York Court System Video FOX 5 New York
Apr 07, 2025 A data leak at South Korean AI company GenNomis exposed 95,000 files, including explicit and potentially illegal content generated by users of their AI tool. This included deepfakes and what appeared to be child sexual abuse material (CSAM). The unprotected database revealed the prompts users had been using to generate these images. Users of GenNomis AI tool Image Tom's Guide
Apr 07, 2025 A boy used AI to generate a fake nude image of Brooke Curry from her Instagram photo and posted it on his Snapchat story. Brooke Curry Image Florida Politics
Apr 05, 2025 China's state-run media used AI-generated videos featuring robots and consumers to criticize U.S. President Donald Trump and tariffs, highlighting the potential for high inflation and economic distress for Americans. One video shows a robot self-destructing rather than implementing high tariffs, and another features an automated voice singing about the negative impacts of tariffs on the American Midwest. Donald Trump and U.S. Tariffs Video Reuters
Apr 03, 2025 Jace Edgar received a phone call where the voice of his sister, Jayla, was cloned using AI to make it sound like she was in distress and needed help after being in an accident. The scammer called him by name and referred to him as brother. Edgar became suspicious and contacted his sister, discovering she was unharmed and unaware of the situation. The scammer called back but Edgar warned them that the police were on their way. Jace Edgar and his sister Jayla Audio 12newsnow.com
Apr 03, 2025 Francesca Mani, a Westfield High School student, was the victim of a deepfake video. The creator only received a short suspension because there were no laws against such media at the time. Francesca Mani Video AP News
Apr 01, 2025 A Jacksonville teenager was victimized by a deepfake and struggled to have it removed. This spurred the creation of Florida Senate Bill 1400, also known as "Brooke's Law", which mandates internet platforms remove such deepfakes within 48 hours of notification. Jacksonville teenager Image Video Florida Politics
Apr 01, 2025 A 61-year-old man, Darrell Devenny, was arrested for creating deepfake images of a child he had sexually abused. The deepfake image was created from a real image of the child taken in public and digitally altered to appear pornographic. He also possessed other explicit images and videos of children. A minor child Image Video NOLA.com
Apr 01, 2025 A deepfake video falsely claiming to show the aftermath of a 7.7 magnitude earthquake in Myanmar on March 28, 2024 circulated on social media. The video, created using AI tools such as Runway and MINIMAX Hailuo AI, showed damaged roads, buildings, and a fire. Inconsistencies in the video, such as stationary people amidst moving fire, and discrepancies with actual footage from the ground, exposed it as a deepfake. The false narrative spread across multiple countries. Myanmar earthquake victims and public perception of the disaster Video Yahoo
Apr 01, 2025 Deepfake technology was used to create non-consensual nude images of children in Malta and Spain. In Malta, at least four cases involved girls having their faces superimposed onto naked bodies or digitally undressed using AI-powered apps. The images were shared via messaging apps to humiliate victims or used for blackmail. In Spain, over 20 teenage girls had their photos manipulated by classmates. The youngest victim in Malta was 12 years old. Children as young as 12 in Malta and Spain Image Times of Malta
Mar 31, 2025 Cybercriminals in Vietnam used deepfake technology to create realistic fake videos of victims and used them for extortion. Victims were threatened with the release of these videos unless they paid a ransom. In one incident, a criminal organization blackmailed entrepreneurs and celebrities, demanding hundreds of millions of đồng. Another incident involved a high school girl who was blackmailed for VNĐ50 million ($2,000). Entrepreneurs, celebrities, high school girl Video vietnamnews.vn
Mar 31, 2025 An AI-generated objectionable video featuring Muskan Rastogi and police officer Ramakant Pachauri went viral. Police confirmed the video's AI origin and malicious intent. An FIR was filed against the uploader. Similar videos allegedly featuring Muskan and co-accused Sahil Shukla also surfaced. Ramakant Pachauri Video Hindustan Times
Mar 30, 2025 A deepfake advertisement featuring Australian media personality Eddie McGuire promoting a fraudulent investment opportunity appeared on YouTube. The ad used footage from a legitimate television appearance, manipulated with a voiceover impersonating McGuire. Inconsistencies in lip syncing and a wavering accent gave the deepfake away. YouTube removed the video for violating its policy against scams using false endorsements. Other celebrities have also been targeted by similar scams. Eddie McGuire Video Audio Australian Broadcasting Corporation
Mar 29, 2025 A six-second deepfake video showing people clinging to a sinking ship went viral in March 2025, garnering over 11 million views. The video, originally watermarked "Daryka," was cropped to remove the AI label. The deepfake resembled real tragedies, such as the June 2023 sinking of a fishing vessel. general public Video Snopes
Mar 28, 2025 A deepfake audio clip falsely depicted JD Vance criticizing Elon Musk. The audio was widely shared on platforms like TikTok and X (formerly Twitter), garnering millions of views. AI detection tools confirmed the audio's inauthenticity. Vance himself denounced it as fake. Several online sources initially shared the audio without verifying its authenticity. JD Vance Audio NewsGuard's Reality Check
Mar 28, 2025 Explicit deepfake videos of Christina Trevanion, a BBC antiques show presenter, were created and circulated online without her permission. She discovered the videos in March 2023, after they had been circulating since September 2022. Christina Trevanion Video HELLO!
Mar 28, 2025 Hema Malini and Vidya Balan have been targeted by deepfakes. AI-generated videos featuring them have been created and spread, causing reputational damage and mental distress. The specifics of the deepfakes and their content are not detailed in the provided text. Hema Malini and Vidya Balan Video The Indian Express
Mar 28, 2025 A deepfake video falsely claiming that Donald Trump criticized Pakistan's treatment of Christians and threatened to relocate all Christian families from the country was viewed over a million times on social media. The video was created using AI and falsely claimed to have aired on BBC News. Analysis revealed inconsistencies in facial expressions, voice, and tone, confirming its fake nature. Donald Trump Video Geo News
Mar 28, 2025 Videos implied to be AI-generated deepfakes of Tamil TV actor Shruthi Narayanan were shared online, causing her emotional distress. Another actor, Shruti Narayanan, clarified she was not involved. Shruthi Narayanan Video Hindustan Times
Mar 27, 2025 American live streamer Johnny Somali (Ramsey Khalid Ismael) was charged with violating South Korea's Special Act on Sexual Violence Crimes due to an AI-generated deepfake video depicting popular Korean streamer BongBong in fabricated intimate scenes with Somali. This charge carries a mandatory prison sentence of up to seven years. BongBong Video Yahoo News
Mar 27, 2025 False YouTube videos claimed that Kenneth Copeland collapsed in a courtroom after receiving a life imprisonment sentence. These videos used AI-generated editing, voice narration, and scripting. One video, published by "The Goateus" on March 2nd, garnered over 190,000 views and featured a doctored image suggesting CNN reported on the event. Another video, published by "niwra" on March 24th, claimed Copeland was sentenced to life imprisonment and garnered around 250,000 views. No credible news sources corroborate these claims. Kenneth Copeland Image Video Snopes.com
Mar 27, 2025 A teacher, Wilson Frederick Jones, used AI to generate sexually explicit videos of eight students. The videos were discovered by the school's Bark application on November 19, 2024, leading to Jones's arrest and charges of production and possession of morphed images of child pornography. The incident was not reported to authorities until January 29, 2025, causing outrage and leading to the termination of the school superintendent. eight Corinth Middle School students (ages 14-16) Video Mississippi Free Press
Mar 27, 2025 A deepfake video of Al Roker promoting a hypertension solution and falsely claiming he suffered two heart attacks circulated on Facebook. The video was removed by Meta, and Roker denied the claims. Al Roker Video WHTC
Mar 26, 2025 Sexually explicit AI-generated images and videos of former NewsChannel 5 meteorologist Bree Smith were used for extortion. Despite being reported to police and social media platforms, the content could not be removed. The perpetrators used the deepfakes to solicit money from Smith's fans. Bree Smith Image Video Tennessean
Mar 25, 2025 A video showing Uttar Pradesh Chief Minister Yogi Adityanath and Bollywood actor Kangana Ranaut hugging is viral. A reverse image search on keyframes revealed the same image in a post by Yogi Adityanath's office on October 1, 2021, showing them posing for a photograph during Ranaut's visit to the CM's residence in Lucknow. An Aaj Tak news report from October 2, 2021, also showed them together, without any altered visuals of a hug. Conclusion: The viral video of Ranaut hugging Adityanath is altered. Yogi Adityanath and Kangana Ranaut Video The Quint
Mar 24, 2025 A deepfake audio clip of Vice President JD Vance criticizing Elon Musk circulated widely on social media. Vance's communications director confirmed the recording is fake. The audio, initially appearing on a TikTok account, features a voice imitating Vance expressing opinions contradicting his public statements. JD Vance Audio Newsweek
Mar 24, 2025 A video showing Prime Minister Narendra Modi seemingly praying in traditional Muslim attire was found to be AI-generated. Inconsistencies in the video, such as distortions in hand movements and unnatural beard growth, were noted. AI detection websites and an AI expert confirmed its AI origin. The video was posted on Instagram by an account with 1116 followers. Prime Minister Narendra Modi Video Vishvas News English
Mar 24, 2025 Multiple voice actors have had their voices cloned and used without their consent or compensation. Nick Meyer's voice was used to create numerous online personas. Joe Gaudet was replaced by his own AI clone. Susan Bennett's voice (Siri) and Bev Standing's voice (TikTok) were used without their knowledge or consent. The incidents highlight the challenges of regulating AI-generated content and the lack of legal protection for voice actors. Voice actors (Nick Meyer, Joe Gaudet, Susan Bennett, Bev Standing) Audio Los Angeles Times
Mar 21, 2025 A pregame hype video created by the Dallas Mavericks used AI to generate facsimiles of players, including Anthony Davis. In one scene, Davis appeared to point a gun at his head. The video was described as "uncanny and haunting" and "nightmarish". The Mavericks organization did not respond to inquiries about the video. Anthony Davis Video Defector
Mar 21, 2025 A deepfake audio clip of Donald Trump falsely announcing the renaming of Washington, D.C., to "District of America" circulated widely on social media. The clip was confirmed as AI-generated by digital forensics experts. It originated from a now-deleted TikTok account (@whmole), which appears to have created other fake Trump audio clips. The audio was shared by both pro and anti-Trump users, garnering millions of views. Donald Trump Audio NewsGuard's Reality Check
Mar 19, 2025 A Texas DPS sergeant, Preston Wade Pietrzykowski, was arrested for possession and promotion of child pornography, some of which were deepfakes. The hard drive also contained deepfakes of female DPS employees' faces superimposed onto sexually explicit images. multiple female DPS employees Image Video MyRGV
Mar 18, 2025 A deepfake video depicts Donald Trump criticizing Volodymyr Zelenskyy's attire and assigning him the nickname "Temu Zelenskiy." The video, created by a parody account named DangerousAI, uses AI-generated voiceovers and original scripts. While a disclaimer clarifies the video's fictional nature, some Facebook users mistook it for authentic. The deepfake incorporates references to a real Oval Office meeting. Volodymyr Zelenskyy and Donald Trump Video Audio Oz Arab Media
Mar 18, 2025 The San Francisco City Attorney's Office shut down nearly a dozen websites distributing AI-generated deepfake nudes. The sites had hundreds of millions of hits annually. The legal action leveraged California's Unfair Competition Law. Unspecified individuals whose faces were used in deepfake nudes Image NBC Bay Area
Mar 18, 2025 A middle school teacher, Wilson Jones, used AI software to generate pornographic videos of students. The videos depicted eight students aged 14-16 in sexually explicit situations. The images were taken from the students' social media accounts without their consent. Jones was charged with production and possession of morphed images of child pornography. The superintendent, Lee Childress, was fired for failing to report the incident immediately. Corinth Middle School students Video FOX13 Memphis
Mar 17, 2025 An AI-generated image falsely depicting Canadian Prime Minister Mark Carney with convicted sex offender Jeffrey Epstein is circulating on social media. The image first appeared online in January 2025 and gained traction after Carney won the Liberal Party leadership. The image shows clear signs of digital manipulation. Mark Carney Image NewsGuard's Reality Check
Mar 15, 2025 A deepfake video of Antonio Brown's return to the Pittsburg Steelers alongside Aaron Rodgers was posted on social media by Antonio Brown. The video is not real and is an attempt by Brown to generate attention. Pittsburgh Steelers, NFL Video Newsweek
Mar 15, 2025 AI-generated video depicting various political figures in unusual scenarios (e.g., Warren and Pelosi in MAGA hats, Trump hugging Obama). Shared on Bluesky by Mark Cuban, prompting controversy due to its political implications and low quality. Elizabeth Warren, Nancy Pelosi, Barack Obama, Donald Trump, Mark Cuban, Jeff Bezos, Mark Zuckerberg, Elon Musk Video Image Gizmodo
Mar 13, 2025 Deepfake videos of experts from The Baker Heart and Diabetes Institute promoting a diabetes supplement; deepfake images of Dr. Karl Kruszelnicki used on Facebook to sell pills; TikTok Shop sellers manipulated doctors' videos to falsely endorse products. The Baker Heart and Diabetes Institute experts, Dr. Karl Kruszelnicki, and other doctors Image Video Audio The Conversation
Mar 12, 2025 A Mississippi teacher, Wilson Jones, was arrested for creating AI-generated videos depicting multiple students in sexual activity. The students were unaware of the videos and did not participate willingly. A search warrant executed on March 3 resulted in the seizure of a laptop and thumb drive containing the videos. The case has been handed to the FBI and the U.S. Attorney's Office. Multiple students Video FOX13 Memphis
Mar 10, 2025 Over 75,000 AI-generated deepfakes of Sony Music artists were taken down. Sony Music reported direct commercial harm and opposes the UK government's proposed 'opt-out' system for AI training data. Sony Music artists Audio Video Music Ally
Mar 08, 2025 Actor Shin Ae-ra was the target of a deepfake attack involving false news about her participation in illegal investment activities. The fake news, which included deepfake images or videos, spread on social media. Shin Ae-ra denied the allegations and her agency is considering legal action. Shin Ae-ra Image Video 매일경제
Mar 07, 2025 AI-generated video linking the Dominican Republic to corruption, parodying "The Island of Temptations", featuring Spanish officials including a shirtless Prime Minister Pedro Sanchez on a beach. The video was viewed over 400,000 times before being deleted by the PP. Dominican Republic Video Reuters
Mar 07, 2025 Deepfake videos and images falsely portraying Singaporean Prime Minister Lawrence Wong promoting scam products and services like cryptocurrency and Permanent Resident application services. Similar incident in June 2024 involving Senior Minister Lee Hsien Loong with deepfake videos commenting on international relations and promoting an investment opportunity linked to Elon Musk. The deepfakes were created using AI. Singaporean Prime Minister Lawrence Wong, Senior Minister Lee Hsien Loong Video Image CNA
Mar 06, 2025 A 15-year-old girl's innocent picture from Instagram was used by a classmate to create a nude deepfake image using an AI app. The image was then distributed throughout her school. Elliston Berry Image Hindustan Times
Mar 05, 2025 A Georgian boiler room operation used deepfakes of celebrities (Ben Fogle, Martin Lewis, and Zoe Ball) to promote fraudulent cryptocurrency investments. Victims were contacted by call centers, initially seeing fake profits before being defrauded of approximately $35 million. A larger network operating from Israel also ran a similar scheme, resulting in an estimated $240 million in losses over three years. UK and Canada residents Video Audio The Guardian
Mar 05, 2025 Scammers used an AI-generated deepfake video of Prime Minister Nikol Pashinyan to promote an investment company promising a monthly income of ֏ 1.8 million ($4,500). Viewers were urged to follow a link and provide personal information. Similar incidents have targeted other Armenian public figures, including RFE/RL and Armenian Public TV anchors and doctors, often to advertise drugs. Prime Minister Nikol Pashinyan Video OC Media
Mar 05, 2025 Investment scams using deepfake technology are targeting investors in the Philippines. Scammers are using AI-generated deepfakes to steal money. The SEC is investigating, tracing bank accounts and digital wallets, and collaborating with online platforms and the DICT to track fraudulent transactions. A fake sponsored post using an old interview of tycoon Ramon Ang is cited as an example. Investors in the Philippines Image Video Fintech News Philippines
Mar 05, 2025 Deepfake videos circulating on social media falsely feature SBI's top management endorsing investment schemes. SBI clarified that neither the bank nor its officials support such schemes. State Bank of India (SBI) and its customers Video Audio The Times of India
Mar 05, 2025 A deepfake video of Queensland Premier Annastacia Palaszczuk garnered 1 million views on social media, falsely claiming the state was in financial trouble. Annastacia Palaszczuk Video The Conversation
Mar 04, 2025 A phishing scam used an AI-generated deepfake video of YouTube CEO Neal Mohan, shared privately, to claim changes to YouTube's monetization policy and steal credentials. Similar scams involved emails and links to malicious files or fake DocuSign sites. One Reddit user reported a deepfake video of Mohan in 2023. YouTube creators Video The Verge
Mar 04, 2025 Europol's Operation Cumberland resulted in the arrest of 24 individuals across 19 countries for their involvement in AI-generated child pornography. A ringleader, operating a website offering AI-created child sexual abuse material (CSAM), was arrested in Denmark in November, initiating the operation. A total of 273 suspects are involved, with 33 house searches conducted and 173 electronic devices seized. The operation highlights the challenges in prosecuting AI-generated CSAM due to a lack of specific national legislation. children Image Video GZERO Media
Mar 03, 2025 A 15-year-old girl, Elliston Berry, was victimized by a classmate who created and spread deepfake nude images of her online using an app. The app has since been removed. Elliston Berry Image The Dallas Morning News
Mar 03, 2025 A 3-minute 33-second deepfake video falsely showed Union finance minister Nirmala Sitharaman endorsing a government investment platform, claiming investors would receive ₹15,00,000 in a month for an investment of ₹21,000. Lip movements were unnatural and out of sync with the speech. Reverse image and voice analysis tools confirmed the video and audio were AI-generated. Nirmala Sitharaman Video Audio Newschecker
Mar 03, 2025 A deepfake video circulating on social media depicts former President Bill Clinton discussing Jeffrey Epstein's client list. The video, shared on X (formerly Twitter), is falsely presented as a recent statement. However, the video originates from a 2020 Bill Clinton speech at the Democratic National Convention. The deepfake video includes text indicating it is satire. A Google Lens search confirmed the source video on NBC News' YouTube channel. AI detection tools showed a 99%+ probability of AI generation, confirming the video as a deepfake. Bill Clinton Video The Quint
Mar 03, 2025 An AI deepfake video of endocrinologist Professor Jonathan Shaw was created calling doctors “idiots” for treating diabetes with metformin. The video was posted on Facebook and was removed only after his employer pointed out a copyright violation. Professor Jonathan Shaw Video Australian Doctor
Mar 02, 2025 AI-generated deepfake videos of Vidya Balan were circulating online. The video showed her greeting viewers. Vidya Balan posted the video on Instagram, warning that it was a scam and that she had not created it. She urged fans to be cautious of misleading AI-generated content. Other celebrities were also targeted by similar deepfakes. Vidya Balan Video Mint
Mar 02, 2025 A young woman, known only as Jodie, was victimized by a deepfake video created by her friend, Alex Woolf, a BBC music prodigy. Woolf used Jodie's images to create a deepfake pornographic video and distributed it online. Jodie discovered the video and identified Woolf by recognizing an image not shared on social media. Woolf pleaded guilty to sending grossly offensive messages, and Jodie's case highlights the challenges in prosecuting such crimes and the lack of adequate legal protection and police response in the UK. Jodie Video Image Daily Mail
Mar 02, 2025 A deepfake video of Indonesian President Prabowo Subianto circulated on Instagram in November. The video showed him asking constituents about their needs, and was used in a scam to swindle Indonesians. Indonesians Video The Caledonian-Record
Feb 28, 2025 An AI-generated video depicting a physical altercation between US President Donald Trump, Vice President JD Vance, and Ukrainian President Volodymyr Zelensky went viral on X. The video shows Zelensky seemingly attacking Trump, with Trump and Vance retaliating. This follows a real-life tense confrontation at the White House where a minerals agreement was not signed. The deepfake video is connected to a real event, but the video itself is fabricated. Donald Trump, JD Vance, Volodymyr Zelensky Video Hindustan Times
Feb 28, 2025 Explicit videos and images of Breeze Liu, some real and some deepfaked, were shared online without her consent in 2020. The content was reportedly filmed when Liu was 17 years old. Some content appeared on Pornhub, and much was stored on Microsoft's Azure cloud servers. Microsoft allegedly failed to respond promptly to Liu's requests for removal, eventually taking down much of the content after a direct confrontation. Breeze Liu Image Video WIRED
Feb 27, 2025 A satirical video falsely claiming Donald Trump would ban Indian customer service representatives in the US was created using Clive AI and shared on January 25th. Contrails AI confirmed the video and audio manipulation. The deepfake was based on a January 10th WAAY 31 News video. Donald Trump Video Audio The Quint
Feb 27, 2025 HYBE is partnering with the Korea’s Northern Gyeonggi Provincial Police Agency to combat deepfake videos targeting its artists. A 2023 study estimated that 53% of individuals in deepfake pornography were South Korean singers or actresses. HYBE's initiative includes a dedicated hotline for reporting deepfake crimes and swift action against offenders. K-Pop artists (specifically those under HYBE) Video MusicRadar
Feb 27, 2025 AI-generated video depicting former President Bill Clinton discussing the anticipated release of Jeffrey Epstein's client list. The video, clearly labeled as satire, shows an AI version of Clinton making statements about the list and includes an AI depiction of Hillary Clinton's voice. While labeled satire, the video has drawn criticism for its potential to spread misinformation. Bill Clinton Video Audio Newsweek
Feb 27, 2025 A fake audio clip of Donald Trump Jr. seemingly supporting Russia's actions in Ukraine was spread across social media. The audio, apparently generated using artificial intelligence, depicts Trump Jr. stating that the U.S. should have sent weapons to Russia instead of Ukraine. A spokesperson for Trump Jr. confirmed that the audio is "100% fake." Deepfake experts analyzed the audio and concluded it was likely AI-generated. The clip was falsely presented as being from a February 25th episode of Trump Jr.'s podcast, "Triggered." The fake audio was shared by accounts including an official Democratic Party account on X (formerly Twitter) before being deleted. Donald Trump Jr. Audio FactCheck.org
Feb 27, 2025 Microsoft sued four developers for creating and selling deepfake nude images of celebrities using compromised accounts and Microsoft AI tools. The developers were part of a cybercrime network called Storm-2139. A website associated with the operation was seized. celebrities Image Gizmodo
Feb 26, 2025 A video depicting Gaza as a futuristic paradise, featuring luxurious buildings, a golden statue of Donald Trump, and scenes of Elon Musk and others. The video includes a song with lyrics about Trump bringing peace and prosperity to Gaza. It was shared by Donald Trump on social media to support his controversial proposal of having Israel take over Gaza. Palestinians, Hamas, and those opposed to Trump's Gaza plan Video The Times of India
Feb 26, 2025 A deepfake video was created using Vijay Kedia's likeness and voice to promote stocks. The deepfake was identified by unnatural aspects such as accent and English fluency, which differed from Kedia's typical speaking style. Kedia warned his followers on social media about this. Vijay Kedia Video Audio The Financial Express
Feb 24, 2025 An AI-generated video depicting President Donald Trump performing oral sex on Elon Musk's feet was displayed on TVs throughout the Department of Housing and Urban Development. The video included the words "LONG LIVE THE REAL KING." Government employees reportedly saw the video playing on a loop Monday morning. Building staff were unable to immediately determine the source. Department of Housing and Urban Development employees Video substack.com
Feb 21, 2025 AI-generated videos falsely depicted a 200-foot tall statue of Jesus being erected on the White House lawn. The videos were shared on Facebook and X. A live White House livestream showed no such construction. An engineering professor noted irregularities in the videos, such as a worker's arm disappearing and equipment distortion affecting the background. The videos originated from a TikTok account known for AI-generated content. Fact-checking organizations debunked the claim. White House Video USA TODAY
Feb 21, 2025 The deepfake pornography app Clothoff creates non-consensual deepfakes, primarily targeting women and minors. The app's connection to ASU Label, an organization with unclear origins and affiliations, is questionable. Clothoff claims to donate to support those affected by AI, but lacks transparency. women and minors Image Video bellingcat
Feb 21, 2025 Two 16-year-old teenagers in Athens were arrested for allegedly creating and sharing AI-generated deepfake nude images of their classmates using photos downloaded from social media without consent. Police confiscated the teenagers' phones and arrested the parents for alleged neglect. classmates of the perpetrators Image Kathimerini English Edition
Feb 21, 2025 Sexually explicit, AI-generated images of female students were circulated online. Two year 11 students have been suspended. Victoria Police are investigating. Up to 60 female students at Gladstone Park Secondary College in Melbourne, Australia Image ABC News
Feb 21, 2025 Three cases filed under the Prevention of Electronic Crimes Act (PECA) 2025 in Lahore, Pakistan, alleging creation and distribution of AI-generated deepfake videos and images depicting Punjab Chief Minister Maryam Nawaz in an immoral light. Additional charges under sections 500, 504, and 505-1 (C) of the Pakistan Penal Code (PPC) were also included. Complaints filed by citizens and businessmen cite uploading on social media, causing reputational harm and spreading misinformation. Maryam Nawaz Image Video DAWN.com
Feb 20, 2025 A deepfake video of CNN's Fareed Zakaria endorsing Kenya's role in Sudan's peace process was shared on X (formerly Twitter) by Kenyan Principal Foreign Affairs Korir Singoei. The video, titled "Kenya steps up: Peacemaking or power play?", presented a positive view of Kenya's actions, but no such video exists on Zakaria's official channels. This caused outrage on social media and questions about Kenya's role in the Sudan crisis. Fareed Zakaria and potentially Kenya's involvement in Sudan's peace process Video The Standard
Feb 20, 2025 A deepfake video showing Zelenskyy's face superimposed onto footage of a person dancing was shared on X by Donald Trump Jr., mocking Zelenskyy. The video was originally posted by another user. This followed Trump's comments calling Zelenskyy a dictator and warning him to end the war quickly. Volodymyr Zelenskyy Video Anadolu Agency | English
Feb 20, 2025 Deepfake videos of Breeze Liu, allegedly filmed without consent when she was 17, appeared on PornHub and other websites in April 2020. The content was hosted on Microsoft's Azure cloud services. Removal of the content was difficult and involved hundreds of images and videos. Microsoft was slow to respond to takedown requests. The National Center for Missing & Exploited Children (NCMEC) could not assist due to uncertainty about Liu's age at the time of filming. Point de Contact, a French victims' aid organization, assisted with takedown requests, leading to some progress by December 2023. Breeze Liu Image Video WIRED
Feb 19, 2025 A new wave of cyberattacks uses AI-generated deepfake videos featuring a synthetic persona ("Thomas Harris" or "Thomas Roberts") to instruct viewers to execute a PowerShell command. This command downloads a malicious script that deploys either Lumma Stealer (to harvest cryptocurrency wallets and browser credentials) or NetSupport RAT (to grant full system control). The deepfakes use procedural details and mimic authentic TradingView workflows. Attackers used compromised YouTube channels with significant subscriber bases and YouTube's sponsored ad system. Cryptocurrency and financial traders Video CybersecurityNews
Feb 19, 2025 Attackers used a deepfake video disguised as a tutorial for unlocking TradingView's developer mode. The video instructed users to execute commands installing malware (NetSupport or Lumma Stealer), granting attackers remote access and enabling data theft. AI-generated personas were used across multiple accounts, with engagement metrics manipulated to enhance credibility. AI tools like ChatGPT were used to create malicious scripts, with attackers adapting C&C domains and using Pasteco to distribute them. The goal was data exfiltration and system compromise, using cryptocurrency as bait. Users of a compromised YouTube channel (over 110,000 subscribers). The attack also leveraged multiple fraudulent YouTube accounts, some with hundreds of thousands of subscribers. Video GBHackers
Feb 19, 2025 Megan Hurley, a massage therapist, was victimized by AI-generated fake nude photos and videos. The bill refers to other victims as well, but does not give specific details. Megan Hurley and other unspecified individuals Image Video MPR News
Feb 19, 2025 Attackers used a deepfake video disguised as a tutorial for unlocking TradingView's developer mode. The video instructed users to execute commands installing malware (NetSupport or Lumma Stealer), granting attackers remote access and enabling data theft. AI-generated personas were used across multiple accounts, with engagement metrics manipulated to enhance credibility. AI tools like ChatGPT were used to create malicious scripts, with attackers adapting C&C domains and using Pasteco to distribute them. The goal was data exfiltration and system compromise, using cryptocurrency as bait. Users of a compromised YouTube channel (over 110,000 subscribers). The attack also leveraged multiple fraudulent YouTube accounts, some with hundreds of thousands of subscribers. Video GBHackers
Feb 18, 2025 AI-generated video of late CM EK Nayanar urging party strengthening was shared on the party's social media. The video, featuring Nayanar in his Kannur dialect, encouraged party members to work towards a third term in the upcoming state elections. This occurred despite the party's previous criticism of AI's potential negative impacts. Kerala CPI(M) party members Video Hindustan Times
Feb 18, 2025 Fraudsters used AI-generated deepfake video calls to impersonate legitimate claim holders, using forged credentials and false addresses. Real claim data, likely obtained from public sources or leaked databases, supported the fake claims. At least $5.6 million was stolen and quickly moved through international exchanges. Companies purchasing fake FTX liquidation claims Video TOKENPOST
Feb 18, 2025 A deepfake video of Sheikh Hasina admitting to creating 'aynaghor' (clandestine detention centers) in Bangladesh is circulating on Facebook. The video is a manipulation of a 2019 BBC News Bangla interview. The deepfake includes a voice clone and lip-sync to match her lip movements to fabricated audio where she claims responsibility for the "aynaghor." Analysis reveals jump cuts and inconsistencies. Reverse image searches confirm the original source is the 2019 interview, where no such admission was made. YouTube has flagged the video as "Altered or Synthetic Media." Sheikh Hasina Video Audio ETV Bharat
Feb 18, 2025 A fraudulent AI-powered ad using Tom Hanks' likeness appeared on YouTube, promoting a fake diabetes cure. The ad manipulated footage from a previous appearance on "Jimmy Kimmel Live!" Tom Hanks Video MediaPost Communications
Feb 18, 2025 Two YouTubers uploaded and broadcasted a deepfake video of President Yoon Suk Yeol and first lady Kim Keon-hee. One YouTuber streamed the video at a rally, and the other posted it multiple times on YouTube. A complaint was filed against the YouTubers for violating the Act on Special Cases Concerning the Punishment of Sexual Crimes. The presidential office requested police to investigate. President Yoon Suk Yeol and first lady Kim Keon-hee Video Anadolu Agency | English
Feb 17, 2025 A five-second AI-generated video falsely depicted the USS Preble firing its HELIOS laser weapon. The video was created from a still image from the Director, Operational Test and Evaluation (DOT&E) 2024 annual report and was not authentic footage. The video's creator admitted to generating it using AI. A Navy spokesperson confirmed the authenticity of the still image but stated that the Navy had not released any videos of the HELIOS system's deployment. U.S. Navy Video Reuters
Feb 17, 2025 Dozens of fraudulent, sexualized deepfake images of female celebrities and athletes were widely shared on Facebook, garnering hundreds of thousands of likes and reshares. Meta removed the images after a CBS News investigation, but many remained publicly available even after being flagged. The deepfakes used AI-generated bodies replacing those of celebrities in real photographs; some used image stitching. Miranda Cosgrove, Jeanette McCurdy, Ariana Grande, Scarlett Johansson, Maria Sharapova Image CBS News
Feb 17, 2025 Georgia Harrison, a reality TV star, was a victim of revenge porn and image-based sexual abuse in 2023. A documentary, ‘Georgia Harrison: Porn, Power, Profit,’ details her experiences and investigation into these issues. Georgia Harrison Image Video Newstalk
Feb 17, 2025 A video showing a girl in a yellow dress falsely claimed to be Monalisa Bhonsale, who went viral selling beads at the Maha Kumbh Mela, is circulating on social media. The Quint fact-checked this video and found it to be a deepfake. The original video is of actor Wamiqa Gabbi, manipulated using face-swap technology to replace Gabbi's face with Bhonsale's. AI detection tools confirmed the video's manipulation, identifying the "FaceSwap technique" with high confidence. This is not the first deepfake incident involving Bhonsale; The Quint previously fact-checked other deepfake videos of her. Monalisa Bhonsale Video The Quint
Feb 17, 2025 A deepfake video showing President Yoon and his wife at a rally was played at a Gwangju rally advocating for the president's impeachment. Police launched an investigation. President Yoon and his wife Video 매일경제
Feb 17, 2025 A deepfake video showing President Yoon and his wife at a rally was played at a Gwangju rally advocating for the president's impeachment. Police launched an investigation. President Yoon and his wife Video 매일경제
Feb 15, 2025 Their photos and names were used without consent to create images showing their faces on nude women performing sexual acts. These images were uploaded to a porn site. 28 North Carolina State University sorority members Image Spectrum News
Feb 15, 2025 A YouTube channel, "True Crime Case Files," created over 150 fabricated true crime videos using AI-generated imagery, ChatGPT scripts, and AI voiceovers. One video falsely depicting a crime in Littleton, Colorado, reached 2 million views before being removed for violating YouTube's community guidelines, particularly those concerning child safety. The channel was terminated. YouTube viewers Image Video Audio Forbes
Feb 13, 2025 Louisiana State Police arrested Ryan Glaser (40) and Gregory Duncan Jr. (24) for creating and distributing deepfake pornography. The investigation began in July 2023 after a routine cell phone check on Glaser, a convicted sex offender, revealed child sex abuse material. Duncan is accused of creating and distributing the deepfake material. A new Louisiana law makes creating or distributing non-consensual pornographic deepfakes illegal, carrying a minimum 10-year prison sentence. unspecified victims of non-consensual pornographic deepfakes Image Video WAFB
Feb 13, 2025 Two K-pop fansites, Eudemonic and Sodapop, allegedly created and distributed deepfake content of IVE's Wonyoung. The fansites were blacklisted by Starship Entertainment in September 2024 following a larger deepfake scandal in South Korea. The February 12, 2025 post reignited outrage among fans demanding further clarification from Starship Entertainment. IVE's Wonyoung Image Video PINKVILLA
Feb 13, 2025 In the TV show *Wagle Ki Duniya*, a deepfake video of Vivaan is used by a stalker to abduct Sakhi. Sakhi believes she's meeting Vivaan, but the cab ride is a trap. The stalker used a deepfake video to manipulate and deceive her. Rajesh and Vivaan work together to rescue her. Sakhi Video The Times of India
Feb 13, 2025 Two men in Louisiana were arrested for creating and distributing deepfake child pornography. Ryan Glaser (40) and Gregory Duncan Jr. (24) were arrested on charges related to possession and distribution of unlawful deepfakes. Glaser, a convicted sex offender, was found with the material during a parole visit. Duncan was identified as the creator and distributor. The investigation involved multiple agencies and was based on Louisiana law 73.13, which criminalizes deepfakes depicting minors in sexual situations. At least 37 states have similar laws. Children Image Video News Talk 96.5 KPEL
Feb 13, 2025 A 33-year-old man from Worcester, Jake Klair, lost £600 to a deepfake scam on Tinder. He believed he was communicating with a US soldier and sent the money for a supposed brother's operation. The scammer used AI to create realistic videos and audio. Jake Klair Video Audio Express
Feb 12, 2025 A deepfake video of Donald Trump urging Vladimir Putin to end the war in Ukraine was created by Ukrainian bloggers and shared on Telegram. The video falsely depicted Trump threatening Putin with the fates of former dictators. It was initially presented as genuine by the Russian messaging platform and some news outlets. The Ukrainian bloggers behind the deepfake later admitted to creating the video to demoralize active Russians. Vladimir Putin Video Voice of America
Feb 12, 2025 Deepfake videos of the author and other celebrities endorsing fake products and investment schemes. Court orders were obtained to remove the videos. Author of the article and other celebrities Video Audio India TV News
Feb 12, 2025 A video on social media shows various Jewish celebrities giving Kanye West the middle finger. The video was created using generative AI without the celebrities' consent and spread quickly due to anger at Kanye West's antisemitism. The video depicts celebrities wearing shirts with a middle finger and Star of David, overlaid on the word "KANYE." It ends with a call to action against antisemitism. Some celebrities depicted have publicly opposed antisemitism, while others haven't. One celebrity, Scarlett Johansson, has previously sued to prevent AI-generated likeness use. Kanye West and various Jewish celebrities Video JTA News - Jewish Telegraphic Agency
Feb 11, 2025 Three videos circulating online falsely depicted Monalisa Bhosle. Two videos used footage of Tanu Rawat with Bhosle's face superimposed, and one used footage of Wamiqa Gabbi. The videos were shared on Facebook, Instagram, YouTube, and X. AI detection tools confirmed the videos as deepfakes. Monalisa Bhosle Video NDTV
Feb 11, 2025 Tens of thousands of deepfake porn images are produced weekly, many targeting celebrities and ordinary women. Sharing these images is a criminal offense under the 2023 Online Safety Act, but creating them is not. A private member's bill introduced by Tory peer Charlotte Owen aimed to ban the creation of such images without consent. The government initially promised to incorporate the bill's provisions into the data bill, but significantly weakened the proposed penalties. Instead of prison time, the government proposed only fines for creating deepfake porn, regardless of the number of offenses. They also added a "reasonable excuse" defense, despite no one being able to identify a valid excuse. celebrities and ordinary women Image Video The Guardian
Feb 10, 2025 A deepfake video of Patrick Mahomes making self-deprecating remarks after the Chiefs' Super Bowl LVII loss went viral on TikTok and YouTube, accumulating millions of views. The video, clearly labeled as AI-generated, used Parrot AI. While the creator's intent was comedic, the video's realism highlights the potential for deepfakes to deceive viewers. Patrick Mahomes Video CNET
Feb 10, 2025 A 61-year-old man, John Cairns, lost \u00a33,250 to a deepfake scam using an AI-generated video of Elon Musk promoting an AI trading platform. Cairns, grieving the loss of his father, invested his inheritance after seeing the Facebook advertisement. He was then contacted by an 'account manager' who guided him through transactions on MetaTrader 5, eventually persuading him to invest more money. After initially withdrawing a small profit, he was prevented from withdrawing larger sums. His daughter's skepticism and online research revealed the scam. John Cairns Video Daily Mail
Feb 10, 2025 A deepfake video of President Prabowo Subianto and other officials was used on Instagram (@indoberbagi2025) to defraud victims in a fake social assistance program. Approximately 100 victims across 20 provinces were defrauded of Rp 65 million by December 2024. President Prabowo Subianto and other officials Video Tempo.co English
Feb 10, 2025 Deepfake videos of Monalisa Bhonsale, a 16-year-old who recently went viral, were created and spread online. One video shows a woman dancing in a red dress, and another shows a woman posing for paparazzi. Both were confirmed as deepfakes using AI face-swap technology. The creator of the dancing video admitted to using a face-swap AI feature. Monalisa Bhonsale Video Image The Quint
Feb 10, 2025 A Hong Kong merchant lost approximately US\$18.5 million in a deepfake scam where the perpetrator used AI-generated voice messages via WhatsApp to impersonate a mainland Chinese company's financial manager and convince the victim to transfer funds for cryptocurrency mining equipment. Hong Kong merchant Audio Bangkok Post
Feb 10, 2025 Deepfake allegations arose concerning a video announcement of a new memecoin by the president of the Central African Republic. AI detection tools gave conflicting results regarding the video's authenticity, with some showing high probability of AI generation. The official X account and website were suspended shortly after the announcement, raising concerns about a potential scam. Central African Republic President Touadéra Video crypto.news
Feb 09, 2025 Simone Simms, owner of an art gallery in Nottingham, was scammed out of £30,000 after falling victim to a deepfake of Pierce Brosnan. The scammers used AI to create convincing images and voice notes of Brosnan to arrange a fake exhibition, leading Simms to sell £20,000 in tickets before the scam was revealed. The deepfake was used in video calls and Telegram messages. Simone Simms Image Audio Daily Mail
Feb 08, 2025 A friend, Andrew Hayler, created and shared deepfake pornographic images and videos of Hannah Grundy and approximately 60 other women, primarily from Sydney, on a website titled "The Destruction of Hannah." The images were sourced from victims' private social media. Hayler was charged with using a carriage service to menace, harass, or cause offense. The case set a legal precedent in Australia due to the lack of specific legislation regarding deepfake pornography at the time. Hannah Grundy and approximately 60 other women Image Video BBC.com
Feb 07, 2025 A deepfake audio of Rihanna boasting about her expensive possessions circulated on Instagram. The AI-generated audio made it sound like Rihanna was listing her Beverly Hills mansion, London rental house, and private jet. Rihanna herself commented on the video, calling out the creator. This isn't the first instance of AI-generated audio featuring Rihanna; a fake Rihanna duet with Bad Bunny also circulated online in 2023. The video's creators did not initially disclose the use of AI but confirmed it in the comments after being questioned. Rihanna Audio Billboard
Feb 07, 2025 A deepfake audio of Rihanna boasting about her expensive possessions circulated on Instagram. The AI-generated audio made it sound like Rihanna was listing her Beverly Hills mansion, London rental house, and private jet. Rihanna herself commented on the video, calling out the creator. This isn't the first instance of AI-generated audio featuring Rihanna; a fake Rihanna duet with Bad Bunny also circulated online in 2023. The video's creators did not initially disclose the use of AI but confirmed it in the comments after being questioned. Rihanna Audio Billboard
Feb 07, 2025 A five-second AI-generated video falsely claiming to show the Ethiopian army parading ballistic missiles was shared on Facebook. The video's artificial nature was revealed by unnatural faces on missile carriers, an AI content detector, and tracing it back to a TikTok user who identified it as an AI video with a watermark that was removed in the Facebook post. Ethiopian Army Video Yahoo! Voices
Feb 07, 2025 An Omaha woman's ex-boyfriend allegedly used AI to create nude photos of her. A local non-profit is advocating for legislation. Omaha woman Image Yahoo! Voices
Feb 04, 2025 A deepfake video went viral on social media, showing comedian Samay Raina joking with Amitabh Bachchan on the show Kaun Banega Crorepati (KBC). The joke about Amitabh Bachchan and Rekha did not appear in the actual episode. AI detection tools confirmed the video and audio as deepfakes. Amitabh Bachchan and Samay Raina Video Audio The Quint
Feb 04, 2025 A deepfake video of Cristiano Ronaldo praising Virat Kohli was shared on Instagram by actor R Madhavan before being revealed as AI-generated by Anushka Sharma. R Madhavan Video Hindustan Times
Feb 03, 2025 AI-generated videos of Donald Trump and Elon Musk were used to defraud supporters into buying worthless Golden Eagles coins, promising substantial returns. One victim invested \$2,500 believing he could exchange coins for \$110,000 each. The coins were confirmed to be nickel, not gold. This follows a pattern of Trump supporters losing money on similar schemes. Supporters of Donald Trump and Elon Musk Video The Independent
Feb 03, 2025 A deepfake audio of Donald Trump's message, "make peace or die", was created and shared. This deepfake fooled some Russians and was used by a Russian lawmaker to accuse Trump of using scare tactics to pressure Putin into peace talks with Ukraine. Vladimir Putin Audio VOA Asia
Feb 03, 2025 A deepfake video featuring Senator Raffy Tulfo and Dr. Willie Ong falsely claims a seven-hour cure for diabetes. The video, posted on Facebook, has garnered significant views. Deepware and Resemble Detect, deepfake detection tools, independently flagged both the video and audio as AI-manipulated. The claim that diabetes is caused by a virus contracted from saltwater and that it can be cured in seven hours is false. Senator Raffy Tulfo and Dr. Willie Ong Video Audio Rappler
Jan 29, 2025 A crime syndicate operating on Telegram, using Chinese communication, launched coordinated attacks targeting African fintechs and companies in Germany and Singapore using deepfake videos. These attacks involved impersonating individuals. The attacks were curbed following intervention by the FBI and African law enforcement after being notified by Smile ID. Deepfakes accounted for 7% of global identity fraud attempts, a fourfold increase from 2023, with Africa experiencing one of the largest regional increases after the Middle East. African fintechs and companies in Germany and Singapore Video Semafor
Jan 29, 2025 A deepfake video appeared to show Carín León kissing Espinoza Paz, leading to rumors about León's sexuality. León addressed the rumors humorously, stating he had 'become gay' three days prior and expressing support for the LGBTQ+ community. The deepfake video increased engagement with his music, particularly his song 'De Compas'. Carín León Video EDGE Media Network
Jan 29, 2025 A 3-minute 27-second video shared by the Aam Aadmi Party (AAP) on X (formerly Twitter) on January 27, 2025, falsely claimed to show Prime Minister Narendra Modi's official residence. Analysis revealed the video to be AI-generated, exhibiting unnatural textures, lack of detail, visual anomalies, and a Sora watermark. AI-content detection tools confirmed its likely AI-generation. Narendra Modi Video Newschecker
Jan 28, 2025 Investigative reporter Patrizia Schlosser was targeted with deepfake pornography on the website MrDeepFakes. The site hosts tens of thousands of videos and images, has close to 650,000 members, and receives millions of visits a month. The content has been viewed almost two billion times. The site's administrators have remained anonymous, using methods like cryptocurrency payments and unverifiable PayPal accounts to obscure ownership. The site advertised apps like Deepswap, which allows users to create deepfake photos and videos. Deepswap was linked to companies with connections to Nexgo, a publicly traded Chinese fintech company. Concerns exist about Nexgo's potential involvement due to Chinese laws prohibiting deepfakes and the complex corporate structure used. Patrizia Schlosser Image Video bellingcat
Jan 28, 2025 A deepfake video depicting TXT's Yeonjun in an intimate moment with an unknown woman went viral, causing outrage among fans. The realism of the AI-generated video and the rise of similar incidents targeting K-pop idols are highlighted. TXT's Yeonjun Video ABP Live
Jan 28, 2025 A deepfake video depicting Barron Trump as unusually tall circulated on social media platforms. The video was deemed false, and the actual footage showed Barron Trump's height to be 2.01 meters. Barron Trump Video Fact Crescendo Sri Lanka
Jan 28, 2025 AI-manipulated videos of Monica Geingos were used in investment scams across various social media platforms. The deepfakes were convincingly realistic. Monica Geingos, former First Lady of Namibia Video Forbes Africa
Jan 25, 2025 AI-generated deepfakes targeting Ukrainian refugees in the US and Denmark, altering their statements and images with fabricated voiceovers to portray them negatively. Stolen footage from reputable media was used. Similar tactics were used against Western journalists. One X post with fabricated videos received over 55,000 views. Ukrainian refugees and Western journalists Video Audio VOA Asia
Jan 24, 2025 A scammer impersonated Elon Musk using deepfake technology in video chats and on Threads to convince a woman to send over $60,000 via gift cards. The scammer promised a Tesla and cash but never delivered. Authorities could not recover the funds. A woman in Lafayette, Louisiana Video Audio VnExpress International
Jan 24, 2025 A 54-year-old school teacher from West Bengal was arrested for her alleged involvement in a ₹1.05 crore online scam. She claims she was duped by someone posing as a popular Bollywood musician via a deepfake video call. The fraudster gained her trust and convinced her to hand over her bank account credentials. Sulapa Mishra Video Audio The Hindu
Jan 23, 2025 A Bengaluru-based chartered accountant lost Rs 23.20 lakh in a stock investment scam using deepfake videos of Mukesh Ambani, Narayana Murthy, and Sudha Murty. The victim saw the videos on Facebook on October 2, 2024, submitted personal details through a link, and made several transfers totaling Rs 23.20 lakh before realizing the scam. A police case was registered on January 13, 2025. B Hari Video Deccan Herald
Jan 23, 2025 An AI-generated video depicts Bayern Munich player Thomas Muller playing for rival club RB Leipzig, causing concern among Bayern fans. The video's realism highlights the potential for deepfakes to spread misinformation. Bayern Munich fans Video Yahoo Sports
Jan 23, 2025 A deepfake video depicting Tony Khan criticizing AEW wrestler Britt Baker during a call with TBS executives. The video is AI-generated and intended to be malicious, aiming to capitalize on Baker's absence from AEW television. Tony Khan and Britt Baker Video WhatCulture
Jan 20, 2025 Vicky Pattison, a British television personality, will release a deepfake pornography video of herself as part of a Channel 4 documentary. The video will be used to highlight the issue of deepfakes and their impact on women. The documentary also features interviews with other victims, including Northern Ireland MLA Cara Hunter and Channel 4 News presenter Cathy Newman. Vicky Pattison Video Yahoo! Voices
Jan 19, 2025 A 27-year-old PE teacher, Cheryl Bennett, was targeted by a deepfake video that falsely portrayed her using racial slurs. The video, manipulated from CCTV footage showing her delivering political leaflets, was posted by a local politician. The video resulted in over 800 complaints, forcing her to take leave from her job. Investigations confirmed the video was manipulated. The perpetrator settled with Bennett and paid substantial damages. Cheryl Bennett Video Audio Daily Mail
Jan 17, 2025 Two teenage boys were charged with creating and distributing 347 AI-generated nude images and videos of approximately 60 students, mostly female and under 18, on Discord. The images were allegedly created using readily available AI apps and photos from the school's Instagram page or FaceTime calls. The school's top leadership stepped aside after a lawsuit for failing to report the activity. Students at Lancaster Country Day School in Pennsylvania Image Video youralaskalink
Jan 16, 2025 Fraudsters stole $35 million using forged emails and deepfake audio a UAE company Audio Built In
Jan 16, 2025 A deepfake porn video featuring TikTok influencer Charli D'Amelio was viewed over 8,200 times on a deepfake pornography site. The video's creator, "DeepWorld23," claimed to have used a deepfake model from GitHub. Videos featuring celebrities like Emma Watson and Taylor Swift have also been created using open-source models from GitHub. Charli D'Amelio, Emma Watson, Taylor Swift Video WIRED
Jan 16, 2025 AI-generated images and videos falsely depicting the Hollywood Sign engulfed in flames went viral on social media platforms like Instagram and X. McAfee researchers confirmed these images as deepfakes, tracing many to Google's Gemini AI image generation platform. The deepfakes were easily created and spread rapidly, reaching over a million views within 24 hours. The Hollywood Sign remains undamaged. Hollywood Sign Image Video Times Now
Jan 15, 2025 A deepfake video advertisement featuring Dr. Tony Leachon promoting a fake prostatitis cure circulated on Facebook. The video, mimicking an ANC news format, used footage from a 2019 interview about hypertension. Leachon's voice was cloned and his mouth movements manipulated to promote a fraudulent product and direct viewers to a fake website (AKELAHORMESCLADE.FUN). Dr. Antonio "Tony" Leachon Video Audio VERA Files
Jan 15, 2025 Starship Entertainment, IVE's agency, reposted deepfake content on its official Chinese Weibo account. The deepfake content maliciously edited IVE members Jang Won Young and An Yu Jin, with An Yu Jin being the primary target. Following fan outrage, Starship apologized on January 15th and disciplined the responsible staff member. IVE’s An Yu Jin and Jang Won Young Image Video soompi
Jan 14, 2025 The daughter of deceased French voice actor Alain Dorval objected to the use of AI to recreate his voice in Sylvester Stallone's film *Armor*. She claims that an agreement was broken, stating that the AI-generated voice, created by ElevenLabs, was used without her permission despite only agreeing to a trial. She insists that neither she nor her mother approved the final product, deeming the quality unacceptable and contrary to her father's wishes. Alain Dorval Audio The Times
Jan 14, 2025 A scammer used AI-generated images and videos of Brad Pitt and his mother to convince Anne to transfer \$1.2 million to a Turkish bank account under the false pretense that Pitt needed the money for kidney cancer treatment. The scam was revealed after Anne appeared on French TV, and the program was later pulled due to online backlash. Similar scams have targeted others, and this is not the first such deepfake scam involving Brad Pitt. Anne, a 53-year-old French interior designer Image Video National Post
Jan 14, 2025 A 77-year-old retired lecturer from Edinburgh, Nikki MacLeod, lost £17,000 in a romance scam involving AI-generated deepfake videos of a fictitious woman, "Alla Morgan." The scammer, posing as "Alla Morgan," built trust by sending MacLeod videos, documents, and a fake bank account. The scam involved multiple requests for money, culminating in an attempt to transfer £65,000. MacLeod recovered £7,000 but lost most of the money sent via PayPal. Police Scotland are investigating. Nikki MacLeod Image Video STV News
Jan 14, 2025 A deepfake video depicting Northern Ireland MLA Cara Hunter in pornographic activity was widely shared in April 2022, causing significant distress and impacting her political career. Police were unable to trace the video's origin due to technological limitations. The incident highlighted the disproportionate targeting of women in deepfake abuse and prompted calls for stronger legislation against the creation of sexually explicit deepfake content. Cara Hunter Video Evening Standard
Jan 14, 2025 A deepfake video circulating on social media depicts Taylor Swift blaming the Los Angeles wildfires on divine retribution for US support of Israel's actions in Gaza. BOOM! analyzed the video and confirmed it's a deepfake. The original footage is from Swift's 2021 appearance on *The Tonight Show Starring Jimmy Fallon*, predating both the wildfires and the Gaza conflict. The video's audio shows discrepancies, indicating AI voice cloning. Reverse image searches and comparisons with the original *Tonight Show* footage confirm manipulation. Taylor Swift Video Audio BOOM
Jan 14, 2025 Sharon Lavy, a Jewish flight attendant, sued Delta Airlines for discrimination and harassment, claiming retaliation after reporting antisemitism and support for Hamas among coworkers. Delta allegedly used "ambush tactics," including a deepfake video showing Lavy on a flight she wasn't trained for, along with other false accusations to justify her firing. A colleague, Roey Segev, filed a similar lawsuit. Sharon Lavy Video VINNews
Jan 13, 2025 A deepfake parody video of Vice President Kamala Harris's presidential campaign ad was created by Christopher Kohls and shared on X (formerly Twitter) by Elon Musk. This video was used in a lawsuit challenging Minnesota's deepfake law. The Attorney General's expert witness used AI-generated false information in their testimony, causing the judge to reject the evidence and severely damaging their credibility. Minnesota Attorney General Keith Ellison Video Reuters
Jan 13, 2025 Deepfake videos were used to spread false narratives, tarnish reputations, and harass women in politics and journalism during elections in Ghana (2020), and planned for Namibia and Senegal (2024). Women in politics and journalism in Africa (Ghana, Namibia, Senegal) Video CIO Africa
Jan 12, 2025 Jodie received an anonymous email with links to a pornographic website containing hundreds of her photos and comments. The poster solicited others to create sexually explicit deepfakes using her images from her private Instagram. Hundreds of synthetic images and videos depicting her in non-consensual sexual situations were created and shared online. This is part of a growing trend of synthetic, sexually explicit content being traded online. The UK government is cracking down on this, but soliciting deepfakes isn't currently illegal. Jodie Image Video The Guardian
Jan 11, 2025 Scammers impersonated Johnny Depp using AI deepfakes on social media to extort money from fans. The deepfakes mimicked Depp's voice and appearance to create fake accounts. Johnny Depp and his fans Image Video Audio Yahoo! Voices
Jan 11, 2025 Morphed images of Bollywood celebrities like Rashmika Mandanna, Alia Bhatt, and Katrina Kaif circulated widely on social media. An individual, Sanket (name changed), was blackmailed using deepfake intimate images after clicking on a malicious advertisement. 84% of social media influencers have reportedly fallen victim to deepfake pornography. Bollywood celebrities and ordinary individuals in India Image Video The Indian Express
Jan 10, 2025 AI-generated nude images of high school students were disseminated on social media. high school students in Westfield, New Jersey Image GoErie.com
Jan 10, 2025 The author of the article was deepfaked by their best friend in 2021. The deepfake involved the creation of realistic images or videos making it appear as though the victim was engaging in intimate or sexual acts without their consent. The perpetrator solicited the creation of the deepfakes. This event prompted the author to advocate for stronger legislation to protect victims of deepfake abuse. Author of the article Image Video GLAMOUR UK
Jan 10, 2025 Deepfake images of IVE members Jang Wonyoung and An Yujin with malicious captions were reposted on Starship Entertainment's official Weibo account before being deleted. Starship Entertainment apologized, stating it was an accident during a report of malicious posts. Fans remain unsatisfied and demand further investigation. IVE members Jang Wonyoung and An Yujin Image PINKVILLA
Jan 09, 2025 Deepfake videos of Dr. Naresh Trehan giving medical advice on urology were created using AI, photoshopping, and voice-over techniques. The videos falsely portrayed Dr. Trehan endorsing natural remedies for prostatitis and erectile dysfunction. They were viewed over 1.1 million times before being taken down by court order. Dr. Naresh Trehan Video Audio The Indian Express
Jan 09, 2025 A high school senior in Sydney, Australia allegedly used AI to create deepfake pornography of female students using images from social media. Fake social media profiles were also created. Parents and students were notified. Police launched an investigation on January 6th. The NSW Department of Education is working with police and will take appropriate action. The incident is considered illegal and abhorrent. A similar incident occurred in Victoria in June 2022. female students at a Sydney high school Image Video New York Post
Jan 08, 2025 A deepfake video falsely portrays UK Prime Minister Keir Starmer admitting to knowing about the Jimmy Savile investigation but dismissing claims as frivolous. The video uses AI-generated audio and manipulated video footage. Experts confirmed the video's AI manipulation and inconsistencies. The original video was from a 2012 Guardian video about social media prosecution guidelines. A previous deepfake of Starmer promoting an investment scheme was also cited. Keir Starmer Video Audio Full Fact
Jan 07, 2025 A deepfake porn website targeted over 30 British female politicians, including Deputy Prime Minister Angela Rayner. Over 30 British female politicians, including Deputy Prime Minister Angela Rayner Image Video News Central
Jan 07, 2025 A pornographic deepfake of Northern Irish politician Cara Hunter was shared before an election, leading to harassment and public questioning. Cara Hunter Image Video THE DECODER
Jan 07, 2025 The Guardian article discusses multiple instances of AI-generated deepfake audio. Georgina Findlay, a YouTube presenter, had her voice used in numerous videos by a far-right channel. Other examples include deepfake audio of Sadiq Khan making inflammatory remarks, David Attenborough's voice used in partisan US news, and a voice eerily similar to Scarlett Johansson's created using OpenAI technology. While specific dates aren't provided for each incident, the article highlights the increasing use of this technology for malicious purposes. Georgina Findlay, Sadiq Khan, David Attenborough, Scarlett Johansson Audio The Guardian
Jan 07, 2025 Deepfake pornography featuring the faces or bodies of at least 250 British celebrities superimposed onto explicit images or videos without their consent. Channel 4 News presenter Cathy Newman and former Love Island contestant Cally Jane Beech shared their experiences. The government is introducing a new offense to address this issue. 250 UK celebrities, including Cathy Newman and Cally Jane Beech Image Video Mint
Jan 07, 2025 From the United States to Italy, Britain, and Pakistan, female politicians are increasingly becoming victims of AI-generated deepfake pornography or sexualized images. An online boom in non-consensual deepfakes is outpacing efforts to regulate the technology globally, with cheap AI tools digitally undressing women. This imagery is used to tarnish reputations, jeopardize careers, undermine public trust, and create conditions for blackmail or harassment. In the U.S., the American Sunlight Project (ASP) identified over 35,000 instances of deepfake content depicting 26 members of Congress—25 women. Nearly one in six women in Congress have been victims. ASP did not release names to avoid public searches but privately notified offices. In the UK, Deputy Prime Minister Angela Rayner was among over 30 British female politicians targeted by a deepfake porn website. In Italy, Prime Minister Giorgia Meloni is seeking damages from two men who created deepfake porn videos of her. In Pakistan, a deepfake video of lawmaker Meena Majeed was debunked, and Information Minister Azma Bukhari was targeted by a deepfake video. Female politicians worldwide Image Video The Hindu
Jan 07, 2025 Social media influencer Cally Jane Beech had an AI-generated nude image created from one of her clothed photos and shared online. She found the deepfake incredibly realistic and reported it to the police, but faced difficulties due to the global nature of the hosting site and the police's unfamiliarity with this type of crime. Cally Jane Beech Image Sky News
Jan 06, 2025 Deepfake pornography and sexualized images targeting female politicians are spreading globally. The American Sunlight Project identified over 35,000 instances of deepfake content depicting 26 members of Congress (25 women) on pornographic sites. A Channel 4 investigation revealed that over 30 British female politicians, including Deputy Prime Minister Angela Rayner, were targeted by a deepfake porn website. Prime Minister Giorgia Meloni is suing two men for creating and distributing deepfake porn videos of her. Deepfake videos targeting female politicians have also surfaced in Pakistan, including fabricated videos of lawmaker Meena Majeed and Information Minister Azma Bukhari. Multiple female politicians across the US, UK, Italy, and Pakistan Image Video The Daily Courier
Jan 05, 2025 A Hong Kong deepfake scam group used deepfakes to impersonate wealthy, single women to defraud victims in Taiwan, Singapore, and Malaysia. Recruits were trained to discuss topics such as expensive red wine and golf, and to learn about victims' finances and cryptocurrency investments to build trust. Over HK$34 million in scam proceeds were intercepted by police. Individuals in Taiwan, Singapore, and Malaysia Image Video Audio South China Morning Post
Jan 03, 2025 Dozens of AI-generated videos depicting Donald Trump making various statements have circulated on social media in Kenya and Nigeria. In Kenya, a deepfake video of Trump threatening to withhold U.S. aid went viral on TikTok and X. In Nigeria, videos showed Trump announcing changes to U.S.-Nigeria immigration policy and calling for the release of Nnamdi Kanu, threatening aid withdrawal if Kanu wasn't released by November 31, 2024. Both videos contained inconsistencies like mismatched lip movements, and claims were unsubstantiated. Kenya and Nigeria Video VOA Asia
Jan 02, 2025 A Royal Air Force veteran, Jonathan Bates (54), received a five-year prison sentence for creating and distributing deepfake pornography of his ex-wife and three other women, whom he stalked for years. The images were posted on pornographic websites, including fake profiles advertising sexual services. The victims suffered severe impacts on their personal and professional lives, including fear, humiliation, and job loss. Police recovered thousands of images from his home. Despite efforts to remove the content, prosecutors stated the images would likely remain online indefinitely. Bates pleaded guilty to four counts of stalking and one count of revenge porn against his ex-wife. Each victim received a 10-year restraining order. ex-wife and three other women Image Video New York Post
Jan 02, 2025 During the Delhi assembly elections in late 2024, the Aam Aadmi Party (AAP) and the Bharatiya Janata Party (BJP) used deepfakes from shows like *Panchayat* and *Maharani*. BJP depicted AAP chief Arvind Kejriwal negatively, while AAP retaliated with deepfakes promoting their schemes. A deepfake of Pankaj Tripathi criticizing BJP was also shared. Other incidents involved Ranveer Singh, Kanchan Nagar, and Rajat Sharma. Zomato also faced criticism for using generative AI to create videos featuring celebrities without permission. Arvind Kejriwal, Atishi Marlena, BJP, AAP, Ranveer Singh, Kanchan Nagar, Rajat Sharma Video Image afaqs!
Dec 30, 2024 A 17-year-old girl, Jaylyn Lee, pleaded not guilty to eight counts of promoting an altered sexual depiction of an identifiable person without consent. Lee is accused of distributing AI-generated nude photos of 14 high school girls. The photos were allegedly created by her 18-year-old ex-boyfriend using an AI app. Lee obtained the photos from her ex-boyfriend's phone, kept them for a month, and then sent them to 17 high school students, some of whom were not depicted in the images. Police stated that the creation or possession of AI-generated nude photos isn't illegal, but distributing them is. While the victims' parents want the ex-boyfriend charged, police say he didn't break any laws because he didn't distribute the photos. Lee's next court date is January 30th. 14 high school girls Image Pensacola News Journal
Dec 30, 2024 AI-generated deepfake images of Taylor Swift circulated on social media, causing widespread outrage. Microsoft responded by improving its deepfake prevention tools. Taylor Swift Image Cornwall Live
Dec 31, 2024 AI-generated deepfakes of Indian politicians were used to spread misinformation during elections. Fake videos of politicians making false claims (e.g., Amit Shah on ending reservations, Supriya Sule on Bitcoin fraud) were created and circulated. Deepfake videos of business leaders promoting investment scams also appeared. Similar tactics were used internationally, including in the Israel-Hamas conflict and in Bangladesh. Multiple political figures in India (Amit Shah, Supriya Sule, etc.) and business leaders (Mukesh Ambani, Sundar Pichai, Elon Musk, etc.) Video Audio Image Vishvas News English
Dec 30, 2024 A 17-year-old girl, Jaylyn Lee, pleaded not guilty to eight counts of promoting an altered sexual depiction of an identifiable person without consent. Lee is accused of distributing AI-generated nude photos of 14 high school girls. The photos were allegedly created by her 18-year-old ex-boyfriend using an AI app. Lee obtained the photos from her ex-boyfriend's phone, kept them for a month, and then sent them to 17 high school students, some of whom were not depicted in the images. Police stated that the creation or possession of AI-generated nude photos isn't illegal, but distributing them is. While the victims' parents want the ex-boyfriend charged, police say he didn't break any laws because he didn't distribute the photos. Lee's next court date is January 30th. 14 high school girls Image Pensacola News Journal
Dec 30, 2024 AI-generated deepfake images of Taylor Swift circulated on social media, causing widespread outrage. Microsoft responded by improving its deepfake prevention tools. Taylor Swift Image The Economic Times
Dec 28, 2024 A classmate created deepfake nude images of them using AI. Police declined to press charges due to legal ambiguities and insufficient evidence of distribution. The girls suffered emotional distress. group of Toronto high school girls Image Toronto Star
Dec 27, 2024 The author of a Channel 4 news report, along with numerous other celebrities and public figures, became victims of deepfake pornography. An investigation revealed millions of views across multiple websites. The article highlights the dehumanizing and violating experience for victims, the slow implementation of regulations, and the continued online presence of deepfakes despite notifications to tech companies. The case of Sophie Parrish, a 31-year-old florist, is used to illustrate the severe emotional distress caused by deepfake nudes. The author of the Channel 4 news report, along with several other celebrities (Taylor Swift, Jenna Ortega, Alexandra Ocasio-Cortez, Georgia Meloni) and other public figures Video Channel 4 News
Dec 26, 2024 Deepfake images of Indian actors Deepika Padukone and Ranveer Singh with their infant daughter, and of actors Rashmika Mandanna and Vijay Deverakonda, circulated on Instagram. The images appeared in Instagram search results and garnered numerous likes despite being absent from the actors' official accounts. The origin of the deepfakes is unclear, and the images lacked AI-generated content labels. Deepika Padukone, Ranveer Singh, Rashmika Mandanna, Vijay Deverakonda Image The Hindu
Dec 21, 2024 A deepfake audio of President Biden urging Democrats not to vote in the New Hampshire primary was created by a Democratic political consultant. This resulted in a $6 million FCC fine and criminal charges. Democratic voters in New Hampshire primary Audio NPR
Dec 21, 2024 Multiple deepfake images of Pope Francis have been generated and circulated online. These include images showing him with Madonna, wearing a Balenciaga puffer jacket, holding a Pride flag, on a beach, and with his face merged with that of an alleged murderer. The images were created using both paid platforms like Krea.ai and freely available models like Stable Diffusion. The creator, RickDick, stated that the images were intended as satire. Pope Francis Image The Guardian
Dec 19, 2024 A 77-year-old woman, Nikki MacLeod, was defrauded of £17,000 through a romance scam involving AI-generated deepfake videos. The scammer, posing as a woman named Alla Morgan working on an oil rig, used the videos to build trust and then requested increasing sums of money under various fabricated pretenses. While some funds were recovered, personal payments sent via PayPal were not. A cybersecurity expert confirmed the videos' manipulation. Nikki MacLeod Video BBC.com
Dec 18, 2024 A 15-year-old girl was victimized by AI-generated deepfake pornography. This prompted Congressional action to mandate social media platforms and websites to remove non-consensual, AI-created pornographic images. 15-year-old girl Image Video CBS News
Dec 18, 2024 A classmate used AI to manipulate a picture of 15-year-old Elliston Berry from her Instagram, removing her dress and distributing the altered image on Snapchat. The image circulated for nine months. This incident prompted Elliston Berry to urge Congress to pass the Take It Down Act. 15-year-old Elliston Berry Image CBS News
Dec 17, 2024 A study by the American Sunlight Project (ASP) found that women in the U.S. Congress are 70 times more likely to be victims of deepfake pornography than their male counterparts. The study analyzed 11 websites and found 26 members of Congress (25 women and one man) in deepfake content. Content targeting 14 members was removed within 48 hours of ASP notification. Women US lawmakers Image Video USA TODAY
Dec 17, 2024 Over 35,000 mentions of nonconsensual intimate imagery (NCII) targeting primarily female members of Congress were found on deepfake websites. The American Sunlight Project (ASP) found that women in Congress are 70 times more likely to be targeted than men. While most imagery was quickly removed after researchers contacted the affected lawmakers, the material can be easily re-shared. The impact extends beyond politics, with high school girls also being targeted. The lack of federal legislation poses risks to national security. 25 female members of Congress and other women in public life Image Video South Carolina Daily Gazette
Dec 12, 2024 AI voice generator Lovo allegedly cloned the voices of voice actors Lehrman and Sage using recordings obtained through Fiverr, without their consent. The actors were misled about how their voice recordings would be used and later discovered that their voices were used commercially on Lovo's platform and in a podcast, under pseudonyms. A lawsuit alleging misuse of voice, copyright infringement and other claims has been filed. Lehrman and Sage Audio The National Law Review
Dec 11, 2024 Two teenage boys created and distributed 347 AI-generated deepfake pornographic images and videos of approximately 60 high school girls using photos from their public social media accounts. The images were shared within the school community. The boys were criminally charged with sexual abuse of children and possession of child pornography. This is considered the largest known instance of this crime involving minors in the US. Parents filed lawsuits against the school for negligence. Approximately 60 high school girls, mostly from Lancaster Country Day School Image Video Forbes
Dec 10, 2024 Houston businessman Gary Cunningham lost $20,000 after criminals cloned his voice using AI to impersonate him to his accountant. In November, a fraudulent wire transfer was initiated, diverting funds to a new bank account. His email had been hacked and his voice cloned. A police report has been filed. Gary Cunningham Audio FOX 26 Houston
Dec 04, 2024 Deepfake ads on YouTube featuring celebrities like Arnold Schwarzenegger, Sylvester Stallone, Mike Tyson, Terry Crews, Tom Hanks, Denzel Washington, and Johnny Sins promoting an erectile dysfunction supplement called "Prolong Power". The ads used AI-generated voices and lip syncing on modified existing videos. The ads directed users to websites with a 40-minute presentation making exaggerated and unsubstantiated claims. Google removed the ads and suspended the account. YouTube users Video Audio 404 Media
Dec 04, 2024 Over 1,100 fraudulent loan application attempts and over 1,000 fraudulent accounts were created using AI-generated deepfake images to bypass biometric verification systems, including liveness detection. Attackers obtained victim IDs through illicit channels (malware, social media, dark web), manipulated the images, and used them to deceive the system. Attackers used AI-generated deepfakes to bypass biometric verification and liveness detection. They also employed virtual camera software and app cloning to manipulate biometric data and simulate multiple devices. Potential losses in Indonesia alone are estimated at $138.5 million. A prominent Indonesian financial institution Image Video Forbes
Nov 29, 2024 A BBC journalist used AI-generated voice cloning technology to bypass the voice ID systems of Santander and Halifax banks by using a recording of her AI-cloned voice saying, "My voice is my password." This highlights the vulnerability of current biometric security measures. Santander and Halifax banks Audio CX Today
Nov 27, 2024 A BBC reporter successfully accessed their bank accounts at Santander and Halifax using an AI-generated clone of their voice. A readily available recording of the reporter's voice was used to create the deepfake. Basic audio equipment was sufficient to bypass security measures. Santander and Halifax bank accounts Audio BBC.com
Nov 25, 2024 A scammer created a deepfake video of Amanda Aguilar and used it on Facebook to contact John Pulido. The scammer, posing as Aguilar, attempted to obtain financial information from Pulido. The deepfake video was convincing enough to initially fool Pulido, but he became suspicious due to requests about his income and requested video proof. Amanda Aguilar Video NBC Washington
Nov 25, 2024 A user was able to clone Kamala Harris' voice and generate inappropriate speech using PlayAI's text-to-speech tool, bypassing the platform's safeguards. PlayAI's community portal also contained content with explicit titles. Kamala Harris Audio TechCrunch
Nov 25, 2024 The voices of several public figures, including Sir David Attenborough, Sir Michael Parkinson, and Bill Gates, were cloned and used without their consent in various scenarios, including fraudulent advertisements and scams. A school principal received death threats via a deepfake audio clip. A CEO's voice was cloned in an attempt (unsuccessful) at corporate espionage. multiple individuals and organizations Audio BBC.com
Nov 24, 2024 A convincing fake Microsoft Teams meeting resulted in a $25 million loss to cybercriminals. Unspecified business Audio eWeek
Nov 24, 2024 Deepfakes of Elon Musk were used in cryptocurrency investment scams, resulting in billions of dollars in losses. One victim, Heidi Swan, lost over \$10,000. The FTC and BBB have issued warnings. The ease of creating these deepfakes was demonstrated using readily available AI tools. Deepfake detection websites show varying accuracy. Elon Musk Video Image CBS News
Nov 23, 2024 Des Healey, a Brighton kitchen fitter, lost £76,000 to a deepfake scam using the likenesses and voices of Martin Lewis and Elon Musk in a fake Facebook advert promoting a Bitcoin investment scheme. He invested his life savings and took out multiple loans before his son alerted him to the scam. Two banks have since canceled his loans, but he still owes approximately £26,000. Des Healey Image Video Audio BBC.com
Nov 18, 2024 David Attenborough's voice was cloned and used in AI-generated deepfakes on YouTube videos about the Ukraine-Russia war and Donald Trump. Attenborough expressed concerns about his identity being stolen and used to promote messages he doesn't endorse. One deepfake creator claimed they weren't impersonating him, despite the obvious similarities. David Attenborough Audio Deadline
Nov 15, 2024 Fake audio messages were used in New Hampshire in January to discourage voting. These messages used a deepfake of President Biden's voice. voters in New Hampshire Audio University of Florida
Nov 01, 2024 A fake AI-generated image of an explosion near the Pentagon circulated on social media, causing temporary market disruption. financial markets Image Center for Strategic & International Studies
Oct 30, 2024 The text describes several types of deepfake scams, including investment scams targeting an 82-year-old who lost \$690,000 to a deepfake Elon Musk, romance scams in Hong Kong resulting in over \$46 million in losses, political scams using AI-generated audio of Joe Biden, extortion scams (grandparent scams) resulting in over \$13 million in losses from January 2020 to June 2021, and celebrity endorsement scams featuring Taylor Swift. Specific details about each incident, such as exact dates and victims names are not provided. Multiple individuals and groups Image Video Audio National Council on Aging
Oct 29, 2024 Scammers used AI to clone Sunil Mittal's voice to attempt to defraud him. The attempt was unsuccessful, but others have lost money to similar scams. Sunil Mittal Audio The Indian Express
Oct 28, 2024 Dozens of Wiz employees received a deepfake voice message seemingly from the CEO, Assaf Rappaport. The deepfake used audio of Rappaport from a conference. The attack aimed to obtain employee credentials. The source of the audio was traced, but the perpetrators remain unidentified. Wiz employees Audio TechCrunch
Oct 17, 2024 Anthony was scammed out of $25,000 after fraudsters used AI to replicate his son's voice. The scammers called, claiming his son had been in an accident and needed bail money. Anthony sent money via Uber drivers who were unaware of the scam. Police confirmed the use of AI voice cloning and warned about the scammers' tactics. Anthony Audio ABC7 Los Angeles
Oct 15, 2024 In early 2020, a Telegram bot was discovered that generated over 100,000 explicit AI-generated images, including those of children. A recent investigation revealed at least 50 Telegram bots claiming to create explicit photos and videos with minimal input, boasting over 4 million combined monthly users. These bots are often supported by associated Telegram channels with millions of subscribers, advertising new features, and offering "tokens" for use. Many bots clearly advertise their function—creating nude or sexually explicit images of women. Some require users to pay for tokens to use the service. One bot, with over 300,000 users, deceptively hid its explicit function behind a non-explicit name and landing page. Following WIRED's contact, Telegram removed 75 identified bots and channels; however, additional channels and bots quickly appeared. Women and children Image Video WIRED
Oct 15, 2024 A romance scam using deepfake AI resulted in losses exceeding $46 million. 28 people were arrested for creating realistic online personas of attractive women to build relationships with victims and coerce them into investing in a fake cryptocurrency platform. A training manual detailed methods to manipulate victims' emotions and trust. This followed a similar case where a Hong Kong company lost $25 million. Men across Asia Image Video CNN
Oct 04, 2024 A deepfake audio clip was created making it seem like the principal made racist and antisemitic comments. This led to death threats, administrative leave for the principal, and significant community division. The creator of the deepfake, the school's athletics director, was charged and is awaiting trial. Eric Eiswert, principal of a high school in Baltimore suburb Audio BBC.com
Oct 02, 2024 Scammers used AI to clone Jay Shooster's voice to convince his parents to send $30,000. They falsely claimed Shooster was in a car accident and needed bail money. Only 15 seconds of Shooster's voice from a recent TV appearance were used to create the AI clone. Jay Shooster's parents Audio NDTV
Sep 30, 2024 In early September 2024, Senator Ben Cardin (D-Md.) received a deepfake Zoom call from an imposter posing as Ukrainian Foreign Minister Dymtro Kuleba. The imposter asked politically charged questions, arousing suspicion. The call was ended, and the Department of State confirmed its inauthenticity. Senator Cardin reported the incident, and an investigation is underway. Senator Ben Cardin Audio Video Dark Reading
Sep 27, 2024 A woman received a call from a voice convincingly mimicking her daughter, demanding a $1 million ransom. While she confirmed her daughter's safety, the incident highlights the sophistication of these scams. woman Audio BECU
Sep 26, 2024 An AI-generated deepfake impersonating Dmytro Kuleba, the former Ukrainian Minister of Foreign Affairs, initiated a video call with Senator Ben Cardin. The deepfake was sophisticated enough to fool initial observation, but inconsistencies were detected, and the call was ended. The incident is considered a targeted attack highlighting the increasing sophistication and potential for future deepfake attacks. Senator Ben Cardin Video Audio The Associated Press
Sep 25, 2024 Elecrow, an electronics manufacturer, used AI to clone the voice of YouTuber Jeff Geerling to promote their products in video tutorials. The cloning was discovered by a subscriber and confirmed by Geerling. Elecrow's CEO apologized and offered compensation. The incident was publicized to raise awareness about AI voice cloning. Jeff Geerling Audio Forbes
Sep 25, 2024 An individual impersonating former Ukrainian Foreign Minister Dmytro Kuleba contacted Senator Ben Cardin via Zoom. The impersonator's voice was likely AI-generated, and the conversation involved politically charged questions about supporting long-range missiles into Russia. The incident was reported to the Senate security office and the FBI and is believed to be an attempt to use the conversation for propaganda purposes, potentially by a Russian government actor. Ben Cardin Audio Video Punchbowl News
Sep 18, 2024 In a deepfake incident, Hong Kong police investigated a case where an employee was tricked into transferring HK$200 million ($20 million USD) to fraudsters who used a deepfake video conference call impersonating company officers. The fraudster likely used AI to add fake voices to pre-downloaded videos. Hong Kong company employee Audio Video The Guardian
Sep 18, 2024 Criminals are using AI to clone voices from just three seconds of audio, obtained from publicly available online content. The AI-powered scam involves cloning a victim's voice and then cold-calling their loved ones to request money. Hundreds of cases have been reported by Starling Bank, and data suggests 28% of UK adults have been targeted. UK adults Audio Entrepreneur
Sep 03, 2024 Scammers stole $25 million from British engineering group Arup by impersonating the CFO using deepfake technology. A staff member transferred funds to Hong Kong accounts after a video conference with the fraudulent CFO and other AI-generated employees. Arup Video Audio CFO Dive
Aug 31, 2024 Lovo, a text-to-speech platform, allegedly obtained voice recordings from Paul Skye Lehrman and Linnea Sage through deception on Fiverr, claiming the recordings were for "research into speech synthesis." Lovo then allegedly created AI clones of their voices and sold them without permission or proper compensation. A lawsuit was filed alleging violations of rights of publicity and breach of contract. Paul Skye Lehrman and Linnea Sage Audio BBC.com
Aug 29, 2024 Multiple scam campaigns using deepfake videos of public figures to promote fake investment schemes and government giveaways. The campaigns were conducted in multiple languages and targeted various countries. A significant number of domains were used, and analysis suggests a single threat actor group was responsible. The Quantum AI campaign is highlighted as an example, using videos featuring Elon Musk, Tucker Carlson, Lee Hsien Loong, and Tharman Shanmugaratnam with AI-generated audio and lip-syncing. Multiple individuals including Elon Musk, Tucker Carlson, Lee Hsien Loong, and Tharman Shanmugaratnam, and various government entities Video Audio Unit 42
Aug 21, 2024 AI-generated robocall impersonating President Biden's voice, urging voters not to vote. Orchestrated by political consultant Steve Kramer, who faces separate penalties. Lingo Telecom, the voice service provider, paid a $1 million fine. New Hampshire Democratic primary voters Audio NBC News
Aug 15, 2024 A robocall featuring an AI-generated voice of President Biden urged Democrats not to vote in the New Hampshire primary. Paul Carpenter created the deepfake and was paid $150 by Steve Kramer, a political consultant who faces charges related to the robocall. The Phillips campaign denied involvement. Democratic voters in the New Hampshire primary Audio CBS Boston
Aug 01, 2024 A manipulated audio and video clip of Kamala Harris was shared by Elon Musk on X, sparking debate about deepfakes and their regulation. The deepfake, viewed over 150 million times, included edited clips and comments on diversity, Biden, and border policies. Similar deepfakes targeting other politicians have also emerged. Kamala Harris Audio Video NBC News
Jul 09, 2024 Robocalls with a deepfake of President Biden's voice discouraged voters in the 2024 New Hampshire presidential primary. The alleged perpetrator was charged with felonies and misdemeanors related to voter suppression and impersonation, and faces a potential $6 million fine from the FCC. New Hampshire primary voters Audio The Fulcrum
Jul 03, 2024 A Baltimore high school principal was falsely depicted making racist and anti-Semitic remarks in a deepfake audio clip shared over 27,000 times. This led to his temporary suspension until the deepfake was proven false, resulting in a teacher's arrest. In February 2023, students in Putnam County, New York, created a deepfake video of their principal making violent threats. While disciplinary action was taken, some parents felt the school's response was insufficient. In October 2023, male students in New Jersey created pornographic deepfakes of female classmates, leading to parental criticism of the school's response. A Seattle-area high school failed to report a similar incident to law enforcement, highlighting the legal obligation to report such cases involving minors. Baltimore high school principal;Putnam County, New York principal;female students in New Jersey;female classmates in Seattle-area high school Audio Video Atkinson, Andelson, Loya, Ruud & Romo
Jun 26, 2024 Two voice actors, Paul Skye Lehrman and Linnea Sage, are suing AI company Lovo for using their voice clips to train an AI voice cloning tool without consent. Their voices were allegedly used in YouTube videos and podcasts. Paul Skye Lehrman and Linnea Sage Audio CBS News
Jun 17, 2024 A deepfake video ad was created by a rival PAC during a Shreveport mayoral race. The ad falsely depicted Perkins as a student being scolded by a principal for failing to keep communities safe and create jobs. Perkins lost his reelection bid and believes the deepfake ad was a significant factor. Adrian Perkins Video PBS NewsHour
May 31, 2024 In January 2024, a deepfake of President Biden's voice, created using ElevenLabs' technology, circulated before the New Hampshire primary. In March 2024, a fabricated recording of a Slovakian presidential candidate falsely boasting about election rigging and price increases went viral, potentially influencing the election results. President Biden, Rishi Sunak, Ursula von der Leyen, Slovakian presidential candidate Audio Oregon Public Broadcasting
May 29, 2024 In January 2024, a Hong Kong firm lost US\$25 million to fraudsters using a deepfake video call to impersonate executives. A Hong Kong firm Video Deloitte
May 23, 2024 AI-generated deepfake robocall impersonating President Biden discouraged voters in New Hampshire's January primary. Political consultant Steve Kramer faces $6 million fine from the FCC and criminal charges for the incident. Democratic voters in New Hampshire Audio NPR
May 09, 2024 Approximately 5,000 New Hampshire voters received a robocall featuring an AI-generated voice of Joe Biden urging them not to vote in the primary, suggesting their votes would benefit Republicans. The software used was from ElevenLabs, requiring only a few hours of voice samples to create a convincing clone. New Hampshire voters Audio The Atlantic
Apr 10, 2024 An AI-generated voice impersonating President Joe Biden was used in a telephone message urging New Hampshire voters to abstain from the presidential primary. Election officials are investigating this incident. New Hampshire voters Audio VOA Learning English
Apr 01, 2024 Imran Khan, Pakistan's jailed former Prime Minister, used AI-generated speeches to reach supporters before the February parliamentary elections. A political operative for Dean Phillips used a robocall impersonating President Joe Biden to discourage voters in the New Hampshire Democratic primary. Imran Khan, Joe Biden Audio Al Jazeera English
Mar 11, 2024 A synthesized version of Will Trapp's voice was used in a phone call scam. The callers, posing as a police officer and then a public defender, instructed Trapp's parents to withdraw $15,000 for his bail after a fake car accident. Will Trapp's parents Audio Mustang News
Mar 07, 2024 A Brooklyn couple, Robin and Steve, were targeted in a deepfake voice scam where the scammers convincingly mimicked the voice of Steve's mother, Mona, to extort money. The scammers demanded money, claiming to hold Mona hostage. After receiving the money via Venmo, they hung up. Mona was unharmed. Robin and Steve Audio The New Yorker

Deepfake Reports

Deepfake Impersonation Targeting Senator Ben Cardin

Deepfake Impersonation Targeting Senator Ben Cardin

Date of Incident: Mid-September 2024Target: Senator Ben Cardin, Chair of the Senate Foreign Relations CommitteeNature of Incident: Sophisticated deepfake impersonation of a high-ranking Ukrainian official In mid-September 2024, Senator Ben Cardin was targeted by a...

LeBron James Olympic Team USA Criticism

LeBron James Olympic Team USA Criticism

On August 9th, 2024, a social media post containing an alleged audio clip of NBA star LeBron James criticizing Team USA head coach Steve Kerr went viral. The post, made by Twitter user @RealRobReinhart, claimed to have obtained "locker room audio" of James disparaging...

Malaysian singer Siti Nurhaliza deepfake

Malaysian singer Siti Nurhaliza deepfake

Overview Malaysian singer Siti Nurhaliza has warned her fans about a viral scam using AI-generated calls, deepfake videos, and images to deceive people into believing she is offering cash rewards or organizing contests. The scammers have hijacked her voice, likeness,...

Joe Biden call to Kamala Harris

Joe Biden call to Kamala Harris

A controversy has emerged regarding the authenticity of Joe Biden’s phone call to Kamala Harris, during her speech to campaign staff members in Delaware. Allegations have circulated that this call was a deepfake, artificially generated using advanced AI technology....

LastPass CEO Audio Deepfake Incident

LastPass CEO Audio Deepfake Incident

LastPass revealed that one of its employees was targeted in a sophisticated voice phishing attack. The attackers used deepfake audio technology to impersonate Karim Toubba, the CEO of LastPass, in an attempt...

Arcads AI Deepfake Video

Arcads AI Deepfake Video

On March 25, 2024, a Twitter user named Beck (@beckylitv) posted a 46-second video that was created using artificial intelligence (AI) technology, specifically the Arcads.ai platform. The video featured a deepfake of an unidentified woman delivering a script in a car....

Cal Poly AI Voice Cloning Scam Case

Cal Poly AI Voice Cloning Scam Case

A recent incident at Cal Poly has highlighted the growing concern over AI voice cloning and its use in phone scams. A family associated with Cal Poly was targeted by scammers who utilized AI voice cloning technology. This technology allows for the creation of...

Deepfake Leads to $25 Million Loss: Employee Tricked by Deepfake CFO

Deepfake Leads to $25 Million Loss: Employee Tricked by Deepfake CFO

A finance worker at a multinational firm was defrauded of $25 million in an elaborate scam involving deepfake technology. The employee was tricked into participating in a video call with several individuals he believed to be colleagues, including the company's...

Deepfake Black Celebrities: AI Misinformation on YouTube

Deepfake Black Celebrities: AI Misinformation on YouTube

Fake news creators on YouTube have been exploiting artificial intelligence (AI) and automated tools to generate and disseminate misinformation targeting Black celebrities, creating a significant challenge in the digital information landscape. This trend of deepfake...

Fake Joe Biden robocall: AI-Generated Election Interference

Fake Joe Biden robocall: AI-Generated Election Interference

In a startling incident that underscores the potential misuse of artificial intelligence in politics, a robocall featuring an AI-generated voice resembling President Joe Biden circulated in New Hampshire, causing...

More From Resemble AI

Replay Attacks: The Blind Spot in Audio Deepfake Detection

Replay Attacks: The Blind Spot in Audio Deepfake Detection

We're thrilled to announce that groundbreaking research from our team at Resemble AI and collaborators, detailed in the paper "Replay Attacks Against Audio Deepfake Detection," has been accepted for presentation at the prestigious Interspeech 2025 conference! This...

read more
Voice Design: Transforming Text into Unlimited AI Voices

Voice Design: Transforming Text into Unlimited AI Voices

Today, we're thrilled to unveil Voice Design, our most groundbreaking feature yet. Voice Design represents a fundamental shift in how creators approach voice generation by translating simple text descriptions into fully-realized AI voices in seconds.The Power of...

read more