Here’s an easy prediction: 2018 will bring mounting pressure to develop large-scale, automated responses to online misinformation. And here’s a hopeful one: That pressure will spark an increasingly frank discussion among journalists, policymakers, and platform companies about how to bolster the fact-building institutions that anchor public truth claims.
The quest to automate online fact-checking began well before the furor over so-called “fake news.” Fact-checks have a consistent structure built around discrete data elements — a claim, a claimant, a verdict — that lends itself to marrying human and machine intelligence in interesting ways. One of the first attempts to do this was Truth Goggles, an MIT project that (as initially conceived in 2011) tried to harness the work of professional fact-checkers to build a “magical button” that would instantly flag false claims on any web page.
Since then, fact-checkers and computer scientists have worked together on a string of projects that aim to automate different part of the fact-checking process. One thing these efforts have in common is using automation as an enhancement, rather than a replacement, for journalistic work — as what Bill Adair, writing in these pages past year, called a “force multiplier” to help human fact-checkers keep up with a growing tide of online misinformation.
For example, the most tedious part of a fact-checker’s job is hunting for interesting and important claims to check; a lot of what politicians say in speeches and debates turns out to be vague rhetoric or statements of opinion. ClaimBuster, developed by computer scientists at the University of Texas at Arlington, pores over transcripts to identify and rank factual statements that fact-checkers might want to investigate. (It also retweets checkable claims here.)
Another promising tool, being developed by the U.K.-based Full Fact, scans media feeds to track which politicians and news outlets are repeating claims that have already been debunked. Called Trends, the project is designed to give the fact-checkers a strategic view of the misinformation landscape, so they can target their corrections more effectively. Political journalists will also be able to use it to guide their reporting.
The most powerful automation technology deployed so far is in some ways the simplest: Since 2016, growing numbers of fact-checkers around the world have been using a new tagging scheme, called ClaimReview, that makes their work legible to algorithms. This means that when Google recognizes the claim being searched for — try “the Russia investigation is a made-up story” — it can preview the verdict in a “snippet” at the top of the search results. (The same tagging system lets the Amazon Echo look up answers to factual queries.)
The research involved in efforts like these has started to bring into view the “holy grail” of an end-to-end fact-checking engine that can check at least some kinds of claims in real time. ClaimBuster and Full Fact have trials in the works (see videos here and here) which operate by matching new claims against fact-checkers’ databases — or, in certain cases, by consulting original data sources such as economic statistics or voting records. As Full Fact noted in a 2016 report, the key to these efforts “is to make sure the kinds of resources fact-checkers can rely on are available as structured data that computers can use.”
And that’s what’s most exciting about these initiatives: Designing the systems to automate verification will draw focus back to the public, institutionally sanctioned data sources that human fact-checkers depend on to certify facts about everything from hurricane strength to inflation rates. These include agencies at every level of government — the U.K.’s Office of National Statistics is an ideal-typical example — as well as countless scientific and civil institutions that set standards and produce benchmark data in different areas of research or policy.
Political fact-checkers couldn’t do what they do without these kinds of institutional resources. Of course, neither could Google’s search algorithms, which depend both directly and indirectly on institutional authority reflected in our patterns of clicking and linking online. In fact, professional fact-checking groups act as a kind of social engine — one of many — for translating institutional knowledge into data that computers can work with.
Reflections on the rise of “algorithmic authority” have tended to oppose it to the institutional kind, based on old-world mechanisms like formal credentialing and peer review. The push for “automated” fact-checking may help us to come to terms with a reality that has always been messier than that, making explicit the institutional subsidy that algorithmic intelligence depends on.
Lucas Graves is senior research fellow at the Reuters Institute for the Study of Journalism and an assistant professor at the University of Wisconsin.
Errin Haines At the ballot, it’s time to count black women
Lam Thuy Vo Breaking free from the tyranny of the loudest
Ernst-Jan Pfauth Publishing less to give readers more
José Zamora Revenue-first journalism
Julia B. Chan Looking for loyalty in all the right places
Hossein Derakhshan Television has won
Kinsey Wilson Facebook and Google: Help out or pay up
C.W. Anderson The social media apocalypse
Nushin Rashidian Publishers seek ad dollar alternatives
Tamar Charney We get serious about algorithms
Helen Havlak Keywords, not publishers, power the world’s biggest feeds
Richard Tofel The platforms’ power demands more reporters’ attention
Juliette De Maeyer A responsible press criticism
Francesco Marconi The year of machine-to-machine journalism
Lanre Akinola Making noise is not a strategy
Alan Soon The rise of start of psychographic, micro-targeted media
Alastair Coote The year of self-improvement
Laura E. Davis Writing answers before you know the question
Mary Meehan Real lives are at stake in rural areas
Rodney Gibbs Tech workers turn to journalism
Basile Simon We need better career paths for news nerds
Jenny Choi Standing up for us and for each other
Molly de Aguiar Good journalism won’t be enough
Kawandeep Virdee Zines had it right all along
Luke O'Neil The end is already here
Gordon Crovitz Serving readers over advertisers
Jim Moroney Newspapers have to be good enough for readers to pay for
Yvonne Leow The rise of video messaging
Sam Ford The year of investing in processes
Adam Thomas Sharing is caring: The year of the mentor
S. Mitra Kalita The arc of news and audience
Justin Kosslyn The year journalists become digital security experts
Steve Grove The midterms are an opportunity
Alice Antheaume Are you fluent in AI?
Jennifer Coogan The future is female
Alfred Hermida Going beyond mobile-first
P. Kim Bui The reckoning is only beginning
Doris Truong Computer vision vs. the Internet vigilantes
Heather Bryant Building the ecosystems for collaboration
Rasmus Kleis Nielsen The Snapchat scenario and the risk of more closed platforms
Pablo Boczkowski The rise of skeptical reading
Jamie Mottram From pageviews to t-shirts
Carrie Brown Transparency finally takes off
Vanessa K. DeLuca Women’s voices take center stage
Sam Sanders Shine the light on ourselves
Amy King Let’s amplify visual voice
Corey Ford The empire strikes back
Rachel Davis Mersey AI, with real smarts
Mira Lowe The year of the local watchdog
Evie Nagy Pivot to mobile video frustration
Bill Keller A growing turn to philanthropy
Marcela Donini and Thiago Herdy Collaboration is the way forward for Brazilian journalism
Frédéric Filloux External forces
Niketa Patel Live journalism comes of age
Andrew Haeg The year journalists become relationship builders
Rick Berke Value is the watchword
Tim Carmody Watch out for Spotify
Jesse Holcomb Information disorder, coming to a congressional district near you
Lucas Graves From algorithms to institutions
Michelle Garcia Navigating journalistic transparency
Sarah Marshall Loyalty as the key performance indicator
Marie Gilot No assholes allowed
Will Sommer The year local media gets conservative
Sally Lehrman Trust comes first
Jared Newman Venture funding and digital news don’t mix
Kristen Muller The year of the voter
Renée Kaplan The year of quiet adjustments (shhh)
Daniel Trielli The rich get richer, the poor scramble
Joanne McNeil Gatekeeping the gatekeepers
Emma Carew Grovum Newsroom culture becomes a priority
Eric Ulken The year local publishers get smart(er) about change
Caitlin Thompson Podcasting models mature and diversify
Eric Nuzum Beyond the narrative arc
Dheerja Kaur Fun with subscription products
Felix Salmon Covering bitcoin while owning bitcoin
Manoush Zomorodi Self-help as a publishing strategy
Ruth Palmer Risks will grow for news subjects — especially minorities
Nik Usher The year of The Washington Post
Millie Tran and Stine Bauer Dahlberg (Hint: It’s about your brand)
Joyce Barnathan It will be harder to bury the news
Juleyka Lantigua Women of color will reclaim and monetize our time
Elizabeth Jensen Show your work
Sydette Harry Listen to your corner and watch for the hook
Charo Henríquez Training is an investment, not an expense
Miguel Castro The arrival of the impact producer
Michael Kuntz The only pivot that might work
Claire Wardle Disinformation gets worse
Julia Beizer A longer view on the pivot
Mariano Blejman News games rule
Cory Corrine Suffering from realness, pivoting to impact
Jacqui Cheng Retailers move into content
Matt Thompson Here come the attention managers
Corey Johnson The pro-fact resistance
Trushar Barot The Jio-fication of India
Nicholas Quah Stop talking trash about young people
Vivian Schiller Pivot to tomorrow
David Skok Finding an information-life balance
Mandy Velez texting is lit rn, fam
Aron Pilhofer We can’t leave the business to the business side any more
Dannagal G. Young Stop covering politics as a game
Tracie Powell The muting of underserved voices
Mario García Storytelling finally adapts to mobile
Carlos Martínez de la Serna The new journalism commons
Jassim Ahmad Thriving on change
Christopher Meighan Passive partnership is in the rearview
Jessica Parker Gilbert Design connects storytelling and strategy
Matt Boggie The intellectual equivalent of the Dead Sea
Andrew Losowsky The year of resilience
Jennifer Brandel and Mónica Guzmán The editorial meeting of the future
Kim Fox Audience teams diversify their approach
Rubina Madan Fillion Unlocking the potential of AI
Brian Lam Sketchy ethics around product reviews
Pia Frey Address users as individuals
Caitria O'Neill The new court of public opinion
Michelle Ferrier The year of the great reckoning
Matt Carlson Attacks on the press will get worse
Rachel Schallom Better design helps differentiate opinion and news
Kyle Ellis Let’s build our way out of this
Jim Brady With the people, not just of the people
Betsy O'Donovan and Melody Kramer Skepticism and narcissism
Alexios Mantzarlis Moving fake news research out of the lab
Mariana Moura Santos Think local, act global
Rodney Benson Better, less read, and less trusted
Federica Cherubini The rise of bridge roles in news organizations
Ray Soto VR reaches the next level
Pete Brown Push alerts, personalized
Debra Adams Simmons And a woman shall lead them
Edward Roussel Eyes, ears, and brains
Craig Newmark Working together toward sustainable solutions
Taylor Lorenz Social and media will split
Raju Narisetti Mirror, mirror on the wall
Nicholas Diakopoulos Fortifying social media from automated inauthenticity
Susie Banikarim R.I.P. Pivot to Video (2017–2017)
Matt DeRienzo A recession, then a collapse
Ståle Grut Reclaiming audience interaction from social networks
Feli Sánchez The year for guerrilla user research
Damon Krukowski Reviving the alt-weekly soul
Monique Judge Letting black women tell their own stories
Tanzina Vega It’s time for media companies to #PassTheMic
Borja Echevarría TV goes digital, digital goes TV
Amie Ferris-Rotman More female reporters abroad (please)
Mike Caulfield Refactoring media literacy for the networked age
Amy Webb Listen to weak signals
Sara M. Watson Feeds will open up to new user-determined filters
Tanya Cordrey Finally, the seeds of radical reinvention
Cindy Royal Your journalism curriculum is obsolete
AX Mina Memes and visuals come to the fore
Kathleen McElroy Building a news video experience native to mobile
Joanne Lipman Journalists inventing revenue streams
Andrew Ramsammy The year ownership mattered
Dan Shanoff You down with OTT? (Yeah, DTC)
Hannah Cassius The year of the echo-chamber escapists
Emily Goligoski Looking beyond news for inspiration
Zizi Papacharissi Women come back
Valérie Bélair-Gagnon Seeking trust in fragmented spaces
Imaeyen Ibanga Longform video leads the way
Mi-Ai Parrish Blockchain and trust
Jarrod Dicker Honesty in advertising
Monika Bauerlein The firehose of falsehood
Raney Aronson-Rath Transparency is the antidote to fake news
All the latest headlines and insights from the world of digital journalism and publishing. Our daily newsletter is a must-read from newsrooms to executive suites.
Nearly there — check your email.
We’ve sent a confirmation link to . Click it and you’re on the list.