Throughout 2017, we’ve spent a lot of time thinking, researching, writing, and talking about how disinformation flows online, about filter bubbles and fact-checking, transparency for news organizations, and other important pieces of the puzzle about how the internet has changed the way so many of us consume and understand information.
But there’s been far too little attention paid to an older form of communication that still has deep influence in our democracy: that old-fashioned thing known as the television, specifically, TV news.
Why? Not because TV news networks, including Fox, MSNBC, and CNN, don’t have influence, but rather because television is difficult to study. Informed voices have urged Facebook to release its data to fact-checkers and others working to improve the quality of news shared online. But TV news content remains both opaque and ephemeral. TV news networks make their content available online generally, but viewers are at their mercy when searching for particular clips, sharing such information elsewhere, or providing structured datasets to help inform research. If a network goes defunct, like Al Jazeera America did, we don’t have any guarantee that material will be preserved.
Enter the Internet Archive, whose mission is to provide universal access to all knowledge. Most journalists know us for the Wayback Machine, which has preserved more than 308 billion webpages online. But the Internet Archive is also home to the TV News Archive, whose collection includes more than 1.4 million TV news shows, searchable by closed captions. We are working hard with partner organizations, with journalists, and with researchers, from Duke Reporters Lab to PolitiFact, from Stanford University to startups like Matroid and Joostware, to turn our archives into data. We are applying machine learning to generate structured data in increasingly sophisticated ways, so that ultimately it will be possible not just to search captions for TV news, but also faces, talking points, identify who is speaking, and more.
For example, in 2016 we launched the Political TV Ad Archive, which used an open source audio fingerprinting tool we called the Duplitron to track political ad airings across key media markets. We fed this information to our fact-checking and journalism partners, who mined it to report on the 2016 elections.
In 2017, we developed the Trump, congressional, and executive branch archives, curated collections of clips by key political and administration figures that can searched by keywords and phrases. We also created Face-o-Matic, which tracks the faces as shown on cable TV news of President Donald Trump and the four top congressional leaders, and Third Eye, which extracts chyrons, or the lower thirds of TV screens, and turns them into downloadable data ready for analysis. The New York Times editorial page, for example, used Third Eye to track how cable news networks differed in their coverage of key indictments in the Russia investigation by special counsel Robert Mueller.
In 2018, we plan to take even greater strides in helping us understand ourselves through TV news. “Who Said What,” by Joostware and “Contextubot,” by Bad Idea Factory, two of the winners of the Knight Foundation’s (in partnership with the Democracy Fund and the Rita Allen Foundation) call for projects to combat misinformation, rely on the TV News Archive to fuel their projects. We’re working with the Duke Reporters Lab on its Tech & Check project to help automate the workflow for fact-checkers. And we’re developing new partnerships with institutions like Stanford University to develop new ways to turn our TV News Archive into data.
We’re talking to media literacy educators about deploying TV News Archive materials into curricula. And in this age of media manipulation, we are exploring ways that we can authenticate TV news clips, so the viewer knows they have not been altered. Finally, we’re expanding our collection of TV beyond national borders, because understanding how others in the world view us, as well as how we view them, will be crucial in the years to come.
Even in 2018, in the era of tablets and phones and Twitter and Facebook and Instagram, TV still affects us all. Knowing our TV is crucial to understanding ourselves.
Nancy Watzman is managing editor of the Internet Archive’s TV News Archive.
Sydette Harry Listen to your corner and watch for the hook
Bill Keller A growing turn to philanthropy
Kyle Ellis Let’s build our way out of this
Taylor Lorenz Social and media will split
Ruth Palmer Risks will grow for news subjects — especially minorities
Sara M. Watson Feeds will open up to new user-determined filters
Mariana Moura Santos Think local, act global
Luke O'Neil The end is already here
Francesco Marconi The year of machine-to-machine journalism
Feli Sánchez The year for guerrilla user research
Dheerja Kaur Fun with subscription products
Michael Kuntz The only pivot that might work
Trushar Barot The Jio-fication of India
Sarah Marshall Loyalty as the key performance indicator
Matt Thompson Here come the attention managers
Evie Nagy Pivot to mobile video frustration
Juleyka Lantigua Women of color will reclaim and monetize our time
Jennifer Coogan The future is female
Rubina Madan Fillion Unlocking the potential of AI
Betsy O'Donovan and Melody Kramer Skepticism and narcissism
Sam Sanders Shine the light on ourselves
Carrie Brown-Smith Transparency finally takes off
Rachel Schallom Better design helps differentiate opinion and news
Mary Meehan Real lives are at stake in rural areas
Carlos Martínez de la Serna The new journalism commons
Pete Brown Push alerts, personalized
Amie Ferris-Rotman More female reporters abroad (please)
Alfred Hermida Going beyond mobile-first
Alastair Coote The year of self-improvement
Joanne McNeil Gatekeeping the gatekeepers
Kristen Muller The year of the voter
Jamie Mottram From pageviews to t-shirts
Tanzina Vega It’s time for media companies to #PassTheMic
Jim Brady With the people, not just of the people
Ståle Grut Reclaiming audience interaction from social networks
Jim Moroney Newspapers have to be good enough for readers to pay for
Juliette De Maeyer A responsible press criticism
Eric Nuzum Beyond the narrative arc
Emma Carew Grovum Newsroom culture becomes a priority
David Skok Finding an information-life balance
Vivian Schiller Pivot to tomorrow
Marie Gilot No assholes allowed
Imaeyen Ibanga Longform video leads the way
Joanne Lipman Journalists inventing revenue streams
Helen Havlak Keywords, not publishers, power the world’s biggest feeds
Cory Haik Suffering from realness, pivoting to impact
Joyce Barnathan It will be harder to bury the news
Umbreen Bhatti The trust problem isn’t new
Kim Fox Audience teams diversify their approach
Dan Shanoff You down with OTT? (Yeah, DTC)
Jassim Ahmad Thriving on change
Hossein Derakhshan Television has won
Aron Pilhofer We can’t leave the business to the business side any more
Andrew Losowsky The year of resilience
Eric Ulken The year local publishers get smart(er) about change
Lucas Graves From algorithms to institutions
Daniel Trielli The rich get richer, the poor scramble
Nikki Usher The year of The Washington Post
Julia B. Chan Looking for loyalty in all the right places
Mary Walter-Brown Show a little vulnerability
Craig Newmark Working together toward sustainable solutions
Rachel Davis Mersey AI, with real smarts
José Zamora Revenue-first journalism
Jessica Parker Gilbert Design connects storytelling and strategy
Errin Haines At the ballot, it’s time to count black women
Caitria O'Neill The new court of public opinion
Molly de Aguiar Good journalism won’t be enough
Mariano Blejman News games rule
Ray Soto VR reaches the next level
Hannah Cassius The year of the echo-chamber escapists
Michelle Ferrier The year of the great reckoning
Andrew Haeg The year journalists become relationship builders
Mike Caulfield Refactoring media literacy for the networked age
Tamar Charney We get serious about algorithms
Heather Bryant Building the ecosystems for collaboration
Monique Judge Letting black women tell their own stories
Elizabeth Jensen Show your work
Gordon Crovitz Serving readers over advertisers
Borja Echevarría TV goes digital, digital goes TV
Manoush Zomorodi Self-help as a publishing strategy
Michelle Garcia Navigating journalistic transparency
Yvonne Leow The rise of video messaging
Jesse Holcomb Information disorder, coming to a congressional district near you
Marcela Donini and Thiago Herdy Collaboration is the way forward for Brazilian journalism
Rasmus Kleis Nielsen The Snapchat scenario and the risk of more closed platforms
Mario García Storytelling finally adapts to mobile
S. Mitra Kalita The arc of news and audience
Laura E. Davis Writing answers before you know the question
Mandy Velez texting is lit rn, fam
Renée Kaplan The year of quiet adjustments (shhh)
Amy King Let’s amplify visual voice
Raju Narisetti Mirror, mirror on the wall
Nicholas Diakopoulos Fortifying social media from automated inauthenticity
Matt Carlson Attacks on the press will get worse
Tanya Cordrey Finally, the seeds of radical reinvention
Felix Salmon Covering bitcoin while owning bitcoin
Matt DeRienzo A recession, then a collapse
Sally Lehrman Trust comes first
Rodney Gibbs Tech workers turn to journalism
Alexios Mantzarlis Moving fake news research out of the lab
Rick Berke Value is the watchword
Miguel Castro The arrival of the impact producer
Nicholas Quah Stop talking trash about young people
Adam Thomas Sharing is caring: The year of the mentor
AX Mina Memes and visuals come to the fore
Jared Newman Venture funding and digital news don’t mix
Cindy Royal Your journalism curriculum is obsolete
Brian Lam Sketchy ethics around product reviews
Federica Cherubini The rise of bridge roles in news organizations
Amy Webb Listen to weak signals
Jennifer Choi Standing up for us and for each other
Pia Frey Address users as individuals
Susie Banikarim R.I.P. Pivot to Video (2017–2017)
Sam Ford The year of investing in processes
Debra Adams Simmons And a woman shall lead them
Dannagal G. Young Stop covering politics as a game
Rodney Benson Better, less read, and less trusted
Edward Roussel Eyes, ears, and brains
Niketa Patel Live journalism comes of age
Julia Beizer A longer view on the pivot
Christopher Meighan Passive partnership is in the rearview
Alice Antheaume Are you fluent in AI?
Caitlin Thompson Podcasting models mature and diversify
Will Sommer The year local media gets conservative
Kinsey Wilson Facebook and Google: Help out or pay up
Basile Simon We need better career paths for news nerds
Monika Bauerlein The firehose of falsehood
Steve Grove The midterms are an opportunity
Mira Lowe The year of the local watchdog
Jacqui Cheng Retailers move into content
Millie Tran and Stine Bauer Dahlberg (Hint: It’s about your brand)
Kawandeep Virdee Zines had it right all along
Valérie Bélair-Gagnon Seeking trust in fragmented spaces
Justin Kosslyn The year journalists become digital security experts
Jennifer Brandel and Mónica Guzmán The editorial meeting of the future
Tim Carmody Watch out for Spotify
Jarrod Dicker Honesty in advertising
Corey Johnson The pro-fact resistance
Nushin Rashidian Publishers seek ad dollar alternatives
Andrew Ramsammy The year ownership mattered
Lanre Akinola Making noise is not a strategy
Kathleen McElroy Building a news video experience native to mobile
Lam Thuy Vo Breaking free from the tyranny of the loudest
Vanessa K. DeLuca Women’s voices take center stage
P. Kim Bui The reckoning is only beginning
Frédéric Filloux External forces
Tracie Powell The muting of underserved voices
Doris Truong Computer vision vs. the Internet vigilantes
Matt Boggie The intellectual equivalent of the Dead Sea
Cristina Wilson The year of the Instagram Story
Charo Henríquez Training is an investment, not an expense
Mi-Ai Parrish Blockchain and trust
Richard Tofel The platforms’ power demands more reporters’ attention
Pablo Boczkowski The rise of skeptical reading
Raney Aronson-Rath Transparency is the antidote to fake news
Damon Krukowski Reviving the alt-weekly soul
Zizi Papacharissi Women come back
Ernst-Jan Pfauth Publishing less to give readers more
C.W. Anderson The social media apocalypse
Claire Wardle Disinformation gets worse
Emily Goligoski Looking beyond news for inspiration
Alan Soon The rise of start of psychographic, micro-targeted media