2
0
1
9

Fighting the reality of deepfakes

“This technology is evolving so rapidly that as quickly as we can find ways to counter it, its creators can adapt it to make it more convincing.”

“Just remember, what you’re seeing and what you’re reading is not what’s happening,” President Donald Trump told the crowd at a Veterans of Foreign Wars event in July.

The remark drew countless comparisons on Twitter to this line from George Orwell’s 1984: “The party told you to reject the evidence of your eyes and ears. It was their final, most essential command.”

The rise of authoritarianism has coincided with the proliferation of “deepfakes” — realistic videos created with artificial intelligence software. This has frightening implications for journalism. If people can no longer believe what they see and what they hear, it’s easy for political leaders to dismiss any evidence-based negative coverage as a fabrication. Facts will continue to lose their power as doctored videos and photos become more sophisticated, casting doubt on primary source material.

Creators of deepfakes employ a variety of techniques, including faceswaps, grafting a lip-syncing mouth or expression onto someone else’s face. An excellent example of this is when Jordan Peele partnered with BuzzFeed in April to create a viral PSA about deepfakes, literally putting words in President Barack Obama’s mouth. Now imagine how this technology could be weaponized against political candidates or used to justify an attack on a foreign power.

Altered videos have already been used to diminish trust in the press. In November, White House Press Secretary Sarah Sanders tweeted a video to justify revoking the credentials of CNN correspondent Jim Acosta. One key moment appeared to be sped up, showing Acosta’s hand rapidly moving down toward a White House intern’s arm. The misleading video was first shared by InfoWars editor-at-large Paul Joseph Watson. When asked about the clip, Sanders’s response was, “The question is did the reporter make contact or not? The video is clear, he did. We stand by our statement.”

The Wall Street Journal is leading the charge in training its journalists to detect deepfakes. Some of the techniques they employ include finding older versions of the footage using reverse image search engines like Tineye and Google Images. Journalists can also use video editing programs to examine the footage frame-by-frame to identify signs like fuzziness around the mouth area, subtle differences in skin tones, or unnatural lighting and movements.

Training journalists is an important step, especially if it’s combined with educating their audiences. News organizations would build trust and lessen the spread of misinformation if they are transparent about how they vet videos and images before reporting on them.

Confirmation bias is a powerful force. That’s why fact-checking Donald Trump’s statements hasn’t had much of an effect on his supporters. If a fake image or video conforms to their worldview, people are inclined to share it. Those who have a negative impression of the media are also less likely to spot a false headline — while being more confident about finding accurate information online.

The 2016 election cycle demonstrated how easy it is to trick millions of people into believing facts that could easily be debunked with a Google search. To be able to identify a deepfake would require not just greater media literacy than many news consumers have, but some technological prowess and a healthy dose of skepticism.

A recent MIT study found that it takes true stories about six times as long as false ones to reach 1,500 people. Bots accelerated the spread of true and false news at the same rate, demonstrating that false news spreads because humans, not robots, are more likely to share it.

Consider the viral image of Trump helping to rescue a Hurricane Harvey flooding victim. There were some obvious indications it wasn’t real, such as the fact that Trump is wearing a suit and no life vest. Yet it was shared hundreds of thousands of times on Twitter and Facebook. Digitally altered images like this damage the credibility of news organizations. In a survey of nearly 6,000 American college students, 36% said the threat of misinformation made them trust all media less.

The most insidious fakes are ones that could be real, based on actual events and news reports. The Washington Post deconstructed one example, showing a commercial plane supposedly doing a 360-degree flip before landing safely in Shenzhen, China. An emergency landing did happen that day at the same airport. The video’s creators spliced together news coverage of it with a 360-degree landing video uploaded a year earlier by a filmmaker and visual effects animator.

Facebook’s machine-learning system detected the fake plane landing video a few days after it was posted, passed it to its network of independent fact-checkers, and eventually ensured it surfaced less in news feeds — but not before it had been viewed 14 million times.

While there are tricks and algorithms to help detect deepfakes, creators have already found ways to counteract them. Computer scientist Siwei Lyu realized he was losing staring contests with celebrities in these videos because they didn’t open and close their eyes as often as real humans. This makes sense, because deepfake programs rely on culling photos and videos of the subjects, and you’re less likely to find those of people blinking.

A few weeks after Lyu’s team published a paper of their findings, they started receiving links to YouTube videos where the subjects closed and opened their eyes naturally. This technology is evolving so rapidly that as quickly as we can find ways to counter it, its creators can adapt it to make it more convincing. As Lyu put it, “the competition between generating and detecting fake videos is analogous to a chess game.”

Rubina Madan Fillion is the director of audience engagement at The Intercept.

Colleen Shalby   Representation becomes more than a talking point

Alexandra Svokos   Good luck convincing us millennials to pay

Ariel Zirulnick   Participation gets professional

Sarah Marshall   A return to destination journalism

Don Day   Timewalls and other reader revenue experiments

Matt Waite   “I went to Node.js because I wished to live deliberately”

Alyssa Zeisler   We expand what (and how and who) we serve

Victor Pickard   We will finally confront systemic market failure

Brian Moritz   The subscription-pocalypse is about to hit

Elva Ramirez   News — but make it cinematic

P. Kim Bui   The misfits become the bosses

Celeste LeCompte   Local news needs local conversation to survive

Frank Chimero   Leave the phone at home and put news on your wrist

Candis Callison   Learn from Indigenous journalists on covering climate change

Kainaz Amaria   We consider who’s behind the camera

Michael Grant   More newsrooms experiment their way to success

Bill Adair   Another year fighting Trump’s falsehoods

John Garrett   You can’t raise prices forever

Steve Myers   From trying to cover it all to covering what matters

Kjerstin Thorson   Time to get mad about information inequality (again)

Stephanie Edgerly   It’s time to understand the un-audience

Elite Truong   What do we owe the next generation?

Zizi Papacharissi   Old interface, say hello to the new interface

Joel Konopo   Influencers become the new liberated power in Africa

Sarah Alvarez   Simplify and redistribute

Alberto Cairo   A year of uncertainty and confidence

Mariana Moura Santos   From pageviews to impact

Mat Yurow   Content competition from the tech companies

Greg Emerson   Power to the user

Patrick Butler   Measuring impact will increase audience trust

Kate Myers   Journalism continues to be bad for democracy

Nicholas Jackson   More transparency around newsroom decisions

Jean Friedman Rudovsky   Cross-newsroom collaborations strengthen communities

Heather Bryant   We are responsible for how we use our power

Mandy Velez   Putting the social back in social media

Mike Caulfield   Ditch the media literacy cynicism and get to work

Peter Bale   Venture capital runs out of patience

Geetika Rudra   The year of actionable (local) journalism

Nikki Usher   Three ways national media will further undermine trust

Umbreen Bhatti   The story doesn’t end for the people we quote

Frank Mungeam   Tonight at 11: News, sports, and climate change

Amy Schmitz Weiss   Local news isn’t where you thought it was

Francesco Marconi   The year of iterative journalism

Manoush Zomorodi   Tech will do for information overload what it did for mindfulness

Jonathan Gill   Publishers build a common tech platform together

Gideon Lichfield   Goodbye attention economy, we’ll miss you

Hearken   Pivot to people

Cristi Hegranes   A year to invest in the security of local journalists

Tshepo Tshabalala   Ahead of African elections, unlock partnerships with fact-checkers

Julia Rubin   Meeting people where they are

Simon Galperin   After capitalism’s fire, journalism’s secondary succession

Talia Stroud   Engaging people across lines of difference

Adam B. Ellick   Video forensic reporting goes mainstream — and local

Julie Posetti   The year of the fight back

Robin Kwong   Tech shouldn’t be the only field pollinating “news nerds”

Peter Cunliffe-Jones   The focus of misinformation debates shifts south

Dave Burdick   Seeing our blind spots

Borja Bergareche Sainz de los Terreros   Entering a more balanced era

Seema Yasmin   We will create our own spaces

Carl Bialik   Fatigued news consumers will pay more for less news

Carolina Guerrero   Spanish-language audio blows up

Angèle Christin   Algorithms and the reflexive turn

Stefanie Murray   Local news wakes up and starts collaborating

Jesse Brown   Canada’s subsidy for news backfires

Heba Aly   The rise of international nonprofit news

Shannon McGregor   More bogus embedded tweets in our stories

Becca Aaronson   From bridge roles to product thinkers

Tamar Charney   Seriously: What do you do for people?

Kristen Muller   Local news fails — in a good way

Jim Friedlich   Meet Citizen Kane 2.0

Francesco Zaffarano   Towards a rethinking of journalism on social media

Christa Scharfenberg and Vickie Baranetsky   The year of the lawsuit

Josh Schwartz   A pullback from platforms and a focus on product

Shalabh Upadhyay   A culture clash on India’s growing Internet

Logan Molyneux   Seeing social media for what it is

Linda Solomon Wood   The year of the climate reporter

Matt Karolian   Publishers come to terms with being Facebook’s enablers

Sue Robinson   Reporters go on the offensive

Rasmus Kleis Nielsen   A long, slow slog, with no one coming to the rescue

Emma Carew Grovum   The year of the loyal reader

Steve Grove   A reckoning for tech’s work with news

Alexis Lloyd & Matt Boggie   The year product leads media

Raney Aronson-Rath   We learn “digital” doesn’t have to mean “short”

Jenée Desmond-Harris   It finally sinks in that some people aren’t white

Robert Hernandez   Racists and sexists get replaced

Justin Kosslyn   Text hits a tipping point

Juleyka Lantigua-Williams   Podcasting battles East Coast bias

Adam Thomas   In Europe, foundations invest in news

Lauren Katz   Community becomes a core newsroom value

james Wahutu   Think 2018 was bad? Wait until you see 2019

Marie Shanahan   Newsrooms take the comments sections back from platforms

Tyler Fisher   This is journalism’s do-or-die moment

Chase Davis   We can acknowledge what we don’t know

Reyhan Harmanci   Selling more stories to Hollywood

Andrew Donohue   Voting rights becomes the new climate change

Ernie Smith   The year we step back from the platform

Nico Gendron   Reaching Generation Z beyond the coasts

Glyn Mottershead and Martin Chorley   When a tech company pulls the plug on your story

Rachel Davis Mersey   Local news goes minimalist

Jonathan Stray   More algorithmic accountability reporting, and a lot of it will be meh

Cătălina Albeanu   Being responsible for what we don’t know

Betsy O'Donovan and Melody Kramer   The most beautiful sentence in 2019 is “No.”

Hossein Derakhshan   The news is dying, but journalism will not — and should not

Joanne McNeil   Building a digital hospice

Andrea Faye Hart   Doing less harm, not just more good

Kyra Darnton   A shift to depth in video

Rick Berke   The year of loyalty

Kelsey Proud   Journalism becomes the escape

Elizabeth Jensen   Going where the Acela can’t take you

Nisha Chittal   The homepage makes a comeback

Renée Kaplan   Our future could lie within our own organizations

Joshua Darr   The nationalization of political news will accelerate

Jeremy Gilbert   AI finally becomes helpful

Millie Tran   There is no magic — you’ve got this

Andrew Ramsammy   The great re-pivot to audio

Eric Ulken   The year you actually start to like your CMS

Elisabeth Goodridge   Yes, they signed up — but our job’s not over

Zainab Khan   Publishers whose products can stand up to social media giants will win

Laura E. Davis   More access, but not that kind

Rachel Glickhouse   Newsrooms will prioritize audience needs

Charo Henríquez   Pivot to journalism

Gabriel Snyder   Journalism doesn’t fit well in a funnel

Moreno Cruz Osório   Damaged credibility and a new threat in Brazil

Renan Borelli   Developing loyalty means developing your talent

Rodney Gibbs   A bright — and young — year for audio

Kawandeep Virdee   Media wants to take care of you

Bill Grueskin   Toward a symphony model for local news

Seth C. Lewis   The gap between journalism and research is too wide

Eric Nuzum   The year of the DIY podcast network

Sue Cross   Return of the water cooler

Rubina Madan Fillion   Fighting the reality of deepfakes

Ole Reißmann   The rise of vertical storytelling

Matt Skibinski   Quality and reliability are the new currencies for publishers

M. Scott Havens   Time to swing for the fences

Kevin Douglas Grant   A year to embrace journalism as public service

Libby Bawcombe   Haikus of the news

Rishad Patel   A design system for responsible publishing

Jonas Kaiser   Catching up with “Neuland”

Jack Riley   Facebook refugees, from ad revenue to news habits

Johannes Klingebiel   We all grow hooves

Taylor Lorenz   Personal branding is more powerful than ever

Michael Rain   The year of the culturally relevant curator

Cindy Royal   For journalism curriculum to change, its faculty needs disruption

Simon Rogers   Data journalism becomes a global field

Mario García   The rise of content “pilots”

Tim Carmody   Unlocking the commons

John Saroff   The pivot to reader revenue’s unintended consequences

Knight Foundation   A year of local collaboration

Joe Amditis   Give the audience a seat at the table

Rebecca Searles   From silos to Swiss Army knife teams

Mandy Jenkins   Fight the urge to run away from social media

An Xiao Mina   The death of consensus, not the death of truth

Claire Wardle   Forget deepfakes: Misinformation is showing up in our most personal online spaces

John Biewen   Podcasts keep getting better

Ben Werdmuller   The platform tide is turning

Carrie Brown-Smith   Advocating a healthy civic life is no journalistic crime

Elizabeth Dunbar   Local reporters reflect on what’s not important

Mike Isaac   The old exit doors for digital media companies are closing

Salem Solomon   Correcting our corrections

A.J. Bauer   The coming splintering of conservative media

Alexandra Borchardt   Newsrooms need to build trust with their journalists, not just the audience

Axie Navas   The traffic hunt, CMS battle, and magazine identity crises loom

LaToya Drake   Listen up: New stories, new storytellers

Ben Smith   The pendulum starts to swing back

Angilee Shah   The year news orgs say “yes” to real leaders

Adam Smith   Platforms will have to help rebuild trust in news

Winny de Jong   Data journalism goes undercover

Jesse Holcomb   We’ll get better at making the case for local journalism

Ståle Grut   A new dawn for 3D tech in journalism

Cory Bergman   Journalism as a technology service

Darryl Holliday   Let’s talk about power (yours)

Rebecca Lee Sanchez   We are all actors in the running rampant of political theater

Almar Latour   Reported facts, weaponized in service of action

Meredith Artley   Huge demand for…anything but politics

Masuma Ahuja   Make foreign coverage less foreign

Jennifer Dargan   You don’t build diversity through one-off training sessions

Jake Shapiro   Podcasting is media’s slow food movement

Elizabeth Bramson-Boudreau   A more sincere definition of “community”

Dheerja Kaur   A focus on problems, not platforms

Sarah Stonbely   Mapping the local news ecosystem — with scale but detail

Soo Oh   Just showing our work isn’t enough

Annie Rudd   A more intimate aesthetic of politics — on Insta

Heather Chaplin   Agree we’re partisan — for the democratic system

Errin Haines Whack   Say it with me: Racism

Ernst-Jan Pfauth   Readers are only getting started

Mike Rispoli and Craig Aaron   Government funds local news — and that’s a good thing

Pia Frey   You can’t solve a crisis without treating it as a crisis

Amy King   We should listen to the kids (especially on Instagram)

Jeff Chin   We detox from Chartbeat

Ruth Palmer and Benjamin Toff   From news fatigue to news avoidance

Thomas Hanitzsch   The rise of tribal journalism

Nathalie Malinarich   Video — yes, video

Matthew Pressman   The battle over objectivity intensifies

Jared Newman   AI-generated fakes launch a software arms race

Craig Newmark   The end of “loudspeakers for liars”

Callie Schweitzer   The rise of the conveners

Tushar Banerjee   Interactive ads will be the new face of display advertising

Steve Henn   Smart speakers get smarter

Cherian George   Fake news wins in Asia

Efrat Nechushtai   Journalism wants to be your friend, not your teacher

Monique Judge   Committing to the truth, calling out lies

Pablo Boczkowski   Reimagining the media for post-institutional times

Dan Shanoff   Bet on sports gambling

Zuzanna Ziomecka   News leadership gets an overdue upgrade

Whitney Phillips   Our information systems aren’t broken — they’re working as intended