We’ve become suspicious of tech. Once obscure issues like the design of news recommendation systems and the evaluation of criminal justice risk scoring methods have become major public conversations. This new scrutiny of technical systems with social impact is well deserved — but that doesn’t mean that we get to be sloppy when investigating the power of algorithms.
The journalistic investigation of the politics of code, sometimes called algorithmic accountability reporting, is one of the more complicated types of reporting to do. The interactions between the technical and the social are intricate. Covering California’s SB 10 bill, which mandates the use of pre-trial statistical risk assessment, requires an understanding of both machine learning error rates and the contentious politics of bail reform. The New York Times tried to make the case that increased social media use in Germany is correlated with more violent attacks on refugees, but the “landmark” study they relied on was actually a preliminary paper. Subsequent analysis suggests that the truth might end up turning on the number of people in the Facebook Nutella group, which the researchers used as a proxy for social media use generally. This stuff is tricky — and because the stakes are so high, everyone has strong opinions.
I’ve already seen several cringe-worthy examples of simplistic, unfounded, or just plain biased reporting on algorithms, including misleading pieces from both tech cheerleaders and tech skeptics. In the hopes of seeing better work in the future, here are a few tips on getting an algorithm story right.
Like any serious journalism, algorithmic accountability reporting requires expertise, curiosity, and dedication to the truth. Increased skepticism of our robot overlords is a good thing, but it doesn’t get to play by different standards than any other investigative journalism.
Jonathan Stray is a computational journalist teaching and researching at Columbia University’s School of Journalism.
Masuma Ahuja Make foreign coverage less foreign
Tushar Banerjee Interactive ads will be the new face of display advertising
Andrew Donohue Voting rights becomes the new climate change
Michael Grant More newsrooms experiment their way to success
Dheerja Kaur A focus on problems, not platforms
Monique Judge Committing to the truth, calling out lies
Ariel Zirulnick Participation gets professional
Jesse Brown Canada’s subsidy for news backfires
Jonathan Gill Publishers build a common tech platform together
John Saroff The pivot to reader revenue’s unintended consequences
Marie Shanahan Newsrooms take the comments sections back from platforms
Simon Rogers Data journalism becomes a global field
Annie Rudd A more intimate aesthetic of politics — on Insta
Dan Shanoff Bet on sports gambling
Chase Davis We can acknowledge what we don’t know
Johannes Klingebiel We all grow hooves
Knight Foundation A year of local collaboration
John Garrett You can’t raise prices forever
Hossein Derakhshan The news is dying, but journalism will not — and should not
Steve Myers From trying to cover it all to covering what matters
Simon Galperin After capitalism’s fire, journalism’s secondary succession
Axie Navas The traffic hunt, CMS battle, and magazine identity crises loom
Andrea Faye Hart Doing less harm, not just more good
Mike Rispoli and Craig Aaron Government funds local news — and that’s a good thing
Seth C. Lewis The gap between journalism and research is too wide
Sue Robinson Reporters go on the offensive
Francesco Zaffarano Towards a rethinking of journalism on social media
Robert Hernandez Racists and sexists get replaced
Zizi Papacharissi Old interface, say hello to the new interface
Soo Oh Just showing our work isn’t enough
Michael Rain The year of the culturally relevant curator
Tyler Fisher This is journalism’s do-or-die moment
Cherian George Fake news wins in Asia
Meredith Artley Huge demand for…anything but politics
Victor Pickard We will finally confront systemic market failure
Elite Truong What do we owe the next generation?
Jeff Chin We detox from Chartbeat
Matt Karolian Publishers come to terms with being Facebook’s enablers
Laura E. Davis More access, but not that kind
Pia Frey You can’t solve a crisis without treating it as a crisis
Darryl Holliday Let’s talk about power (yours)
Cindy Royal For journalism curriculum to change, its faculty needs disruption
Josh Schwartz A pullback from platforms and a focus on product
Justin Kosslyn Text hits a tipping point
Bill Adair Another year fighting Trump’s falsehoods
Ernst-Jan Pfauth Readers are only getting started
Efrat Nechushtai Journalism wants to be your friend, not your teacher
Heather Chaplin Agree we’re partisan — for the democratic system
Jennifer Dargan You don’t build diversity through one-off training sessions
Greg Emerson Power to the user
Shannon McGregor More bogus embedded tweets in our stories
Sarah Marshall A return to destination journalism
Glyn Mottershead and Martin Chorley When a tech company pulls the plug on your story
Alexis Lloyd & Matt Boggie The year product leads media
Thomas Hanitzsch The rise of tribal journalism
Alberto Cairo A year of uncertainty and confidence
Nisha Chittal The homepage makes a comeback
Frank Chimero Leave the phone at home and put news on your wrist
Alexandra Svokos Good luck convincing us millennials to pay
Zuzanna Ziomecka News leadership gets an overdue upgrade
Rachel Davis Mersey Local news goes minimalist
AX Mina The death of consensus, not the death of truth
Joanne McNeil Building a digital hospice
Charo Henríquez Pivot to journalism
Alexandra Borchardt Newsrooms need to build trust with their journalists, not just the audience
Rachel Glickhouse Newsrooms will prioritize audience needs
Kevin D. Grant A year to embrace journalism as public service
Jim Friedlich Meet Citizen Kane 2.0
Adam B. Ellick Video forensic reporting goes mainstream — and local
A.J. Bauer The coming splintering of conservative media
Geetika Rudra The year of actionable (local) journalism
Tshepo Tshabalala Ahead of African elections, unlock partnerships with fact-checkers
Heba Aly The rise of international nonprofit news
Kawandeep Virdee Media wants to take care of you
Rodney Gibbs A bright — and young — year for audio
Bill Grueskin Toward a symphony model for local news
Kainaz Amaria We consider who’s behind the camera
Sarah Alvarez Simplify and redistribute
Joel Konopo Influencers become the new liberated power in Africa
Rebecca Searles From silos to Swiss Army knife teams
Libby Bawcombe Haikus of the news
Ståle Grut A new dawn for 3D tech in journalism
Don Day Timewalls and other reader revenue experiments
Claire Wardle Forget deepfakes: Misinformation is showing up in our most personal online spaces
Angèle Christin Algorithms and the reflexive turn
Mario García The rise of content “pilots”
Carolina Guerrero Spanish-language audio blows up
Renée Kaplan Our future could lie within our own organizations
Elva Ramirez News — but make it cinematic
Celeste LeCompte Local news needs local conversation to survive
John Biewen Podcasts keep getting better
M. Scott Havens Time to swing for the fences
Julie Posetti The year of the fight back
Millie Tran There is no magic — you’ve got this
Manoush Zomorodi Tech will do for information overload what it did for mindfulness
Jack Riley Facebook refugees, from ad revenue to news habits
Peter Bale Venture capital runs out of patience
Stefanie Murray Local news wakes up and starts collaborating
Betsy O'Donovan and Melody Kramer The most beautiful sentence in 2019 is “No.”
Patrick Butler Measuring impact will increase audience trust
Salem Solomon Correcting our corrections
Colleen Shalby Representation becomes more than a talking point
Christa Scharfenberg and Vickie Baranetsky The year of the lawsuit
Nik Usher Three ways national media will further undermine trust
Cristi Hegranes A year to invest in the security of local journalists
Matthew Pressman The battle over objectivity intensifies
Emma Carew Grovum The year of the loyal reader
Joshua P. Darr The nationalization of political news will accelerate
Andrew Ramsammy The great re-pivot to audio
Craig Newmark The end of “loudspeakers for liars”
Stephanie Edgerly It’s time to understand the un-audience
Catalina Albeanu Being responsible for what we don’t know
Steve Henn Smart speakers get smarter
Rishad Patel A design system for responsible publishing
Elisabeth Goodridge Yes, they signed up — but our job’s not over
Sue Cross Return of the water cooler
Callie Schweitzer The rise of the conveners
Linda Solomon Wood The year of the climate reporter
Whitney Phillips Our information systems aren’t broken — they’re working as intended
Gabriel Snyder Journalism doesn’t fit well in a funnel
Jenée Desmond-Harris It finally sinks in that some people aren’t white
Cory Bergman Journalism as a technology service
Dave Burdick Seeing our blind spots
Nicholas Jackson More transparency around newsroom decisions
Mike Caulfield Ditch the media literacy cynicism and get to work
Talia Stroud Engaging people across lines of difference
Brian Moritz The subscription-pocalypse is about to hit
Winny de Jong Data journalism goes undercover
Kjerstin Thorson Time to get mad about information inequality (again)
Ben Werdmuller The platform tide is turning
Jake Shapiro Podcasting is media’s slow food movement
Lauren Katz Community becomes a core newsroom value
Mandy Jenkins Fight the urge to run away from social media
P. Kim Bui The misfits become the bosses
Jonathan Stray More algorithmic accountability reporting, and a lot of it will be meh
Tamar Charney Seriously: What do you do for people?
Ole Reißmann The rise of vertical storytelling
Eric Nuzum The year of the DIY podcast network
Matt Waite “I went to Node.js because I wished to live deliberately”
Mat Yurow Content competition from the tech companies
Jeremy Gilbert AI finally becomes helpful
Borja Bergareche Sainz de los Terreros Entering a more balanced era
Juleyka Lantigua Podcasting battles East Coast bias
Matt Skibinski Quality and reliability are the new currencies for publishers
Sarah Stonbely Mapping the local news ecosystem — with scale but detail
Errin Haines Say it with me: Racism
Steve Grove A reckoning for tech’s work with news
Candis Callison Learn from Indigenous journalists on covering climate change
Kelsey Proud Journalism becomes the escape
Adam Thomas In Europe, foundations invest in news
Umbreen Bhatti The story doesn’t end for the people we quote
Angilee Shah The year news orgs say “yes” to real leaders
Mandy Velez Putting the social back in social media
Nathalie Malinarich Video — yes, video
Jared Newman AI-generated fakes launch a software arms race
Eric Ulken The year you actually start to like your CMS
Kate Myers Journalism continues to be bad for democracy
Shalabh Upadhyay A culture clash on India’s growing Internet
Almar Latour Reported facts, weaponized in service of action
Pablo Boczkowski Reimagining the media for post-institutional times
Reyhan Harmanci Selling more stories to Hollywood
Zainab Khan Publishers whose products can stand up to social media giants will win
Adam Smith Platforms will have to help rebuild trust in news
Carrie Brown Advocating a healthy civic life is no journalistic crime
Heather Bryant We are responsible for how we use our power
Nico Gendron Reaching Generation Z beyond the coasts
Amy King We should listen to the kids (especially on Instagram)
Raney Aronson-Rath We learn “digital” doesn’t have to mean “short”
Ernie Smith The year we step back from the platform
Seema Yasmin We will create our own spaces
Jonas Kaiser Catching up with “Neuland”
Joe Amditis Give the audience a seat at the table
Frank Mungeam Tonight at 11: News, sports, and climate change
Tim Carmody Unlocking the commons
Jesse Holcomb We’ll get better at making the case for local journalism
Jean Friedman Rudovsky Cross-newsroom collaborations strengthen communities
Ruth Palmer and Benjamin Toff From news fatigue to news avoidance
Elizabeth Jensen Going where the Acela can’t take you
Renan Borelli Developing loyalty means developing your talent
Robin Kwong Tech shouldn’t be the only field pollinating “news nerds”
Amy Schmitz Weiss Local news isn’t where you thought it was
Peter Cunliffe-Jones The focus of misinformation debates shifts south
Taylor Lorenz Personal branding is more powerful than ever
Rubina Madan Fillion Fighting the reality of deepfakes
Ben Smith The pendulum starts to swing back
Moreno Cruz Osório Damaged credibility and a new threat in Brazil
Francesco Marconi The year of iterative journalism
Carl Bialik Fatigued news consumers will pay more for less news
Kyra Darnton A shift to depth in video
Alyssa Zeisler We expand what (and how and who) we serve
Rick Berke The year of loyalty
LaToya Drake Listen up: New stories, new storytellers
J. Siguru Wahutu Think 2018 was bad? Wait until you see 2019
Rasmus Kleis Nielsen A long, slow slog, with no one coming to the rescue
Rebecca Lee Sanchez We are all actors in the running rampant of political theater
Elizabeth Dunbar Local reporters reflect on what’s not important
Elizabeth Bramson-Boudreau A more sincere definition of “community”
Gideon Lichfield Goodbye attention economy, we’ll miss you
Mariana Moura Santos From pageviews to impact
Logan Molyneux Seeing social media for what it is
Mike Isaac The old exit doors for digital media companies are closing
All the latest headlines and insights from the world of digital journalism and publishing. Our daily newsletter is a must-read from newsrooms to executive suites.
Nearly there — check your email.
We’ve sent a confirmation link to . Click it and you’re on the list.