Nieman Foundation at Harvard
HOME
          
LATEST STORY
You’re more likely to believe fake news shared by someone you barely know than by your best friend
ABOUT                    SUBSCRIBE
April 23, 2024, 8:30 a.m.

Deepfake detection improves when using algorithms that are more aware of demographic diversity

“Our research addresses deepfake detection algorithms’ fairness, rather than just attempting to balance the data. It offers a new approach to algorithm design that considers demographic fairness as a core aspect.”

Deepfakes — essentially putting words in someone else’s mouth in a very believable way — are becoming more sophisticated by the day and increasingly hard to spot. Recent examples of deepfakes include Taylor Swift nude images, an audio recording of President Joe Biden telling New Hampshire residents not to vote, and a video of Ukrainian President Volodymyr Zelenskyy calling on his troops to lay down their arms.

Although companies have created detectors to help spot deepfakes, studies have found that biases in the data used to train these tools can lead to certain demographic groups being unfairly targeted. My team and I discovered new methods that improve both the fairness and the accuracy of the algorithms used to detect deepfakes.

To do so, we used a large dataset of facial forgeries that lets researchers like us train our deep-learning approaches. We built our work around the state-of-the-art Xception detection algorithm, which is a widely used foundation for deepfake detection systems and can detect deepfakes with an accuracy of 91.5%.

We created two separate deepfake detection methods intended to encourage fairness. One was focused on making the algorithm more aware of demographic diversity by labeling datasets by gender and race to minimize errors among underrepresented groups. The other aimed to improve fairness without relying on demographic labels, by focusing instead on features not visible to the human eye.

It turns out the first method worked best. It increased accuracy rates from the 91.5% baseline to 94.17%, which was a bigger increase than our second method as well as several others we tested. Moreover, it increased accuracy while enhancing fairness, which was our main focus.

We believe fairness and accuracy are crucial if the public is to accept artificial intelligence technology. When large language models like ChatGPT “hallucinate,” they can perpetuate erroneous information. This affects public trust and safety.

Likewise, deepfake images and videos can undermine the adoption of AI if they cannot be quickly and accurately detected. Improving the fairness of these detection algorithms so that certain demographic groups aren’t disproportionately harmed by them is a key aspect to this.

Our research addresses deepfake detection algorithms’ fairness, rather than just attempting to balance the data. It offers a new approach to algorithm design that considers demographic fairness as a core aspect.

Siwei Lyu is a professor of computer science and engineering at the University of Buffalo and director of the UB Media Forensic Lab. Yan Ju is a Ph.D. candidate in computer science and engineering at the University at Buffalo. This article is republished from The Conversation under a Creative Commons license.The Conversation

Image of a Barack Obama deepfake from a 2019 study by Shruti Agarwal of U.C. Berkeley.

POSTED     April 23, 2024, 8:30 a.m.
Show tags
 
Join the 60,000 who get the freshest future-of-journalism news in our daily email.
You’re more likely to believe fake news shared by someone you barely know than by your best friend
“The strength of weak ties” applies to misinformation, too.
To find readers for longform investigations, Public Health Watch leans on partners and in-person work
Nonprofit newsrooms are competing for limited funding and attention spans, grappling with diminishing returns on social, and trying to address low trust in media. It’s forcing outlets large and small to adapt to survive.
Could social media support healthy online conversations? New_ Public is working on it
“We talk to a lot of towns where there is no newspaper anymore; there’s no community center anymore; the town store shut down. And this is kind of it.”