Unlocking the potential of AI

“Collaboration will be critical to advance how newsrooms use AI. That could mean a consortium of newsrooms working together on ambitious machine learning projects.”

News organizations are fighting for attention. They’re competing against technology companies that are much more adept at personalization. Netflix, Amazon, and Facebook have created addictive products by predicting users’ future behavior and honing in on their preferences. The more data they gather, the more they refine this process. If media organizations want to capture some of that attention, they have to improve how they personalize their audiences’ experiences. Artificial intelligence presents a way to offer hyperlocal, personalized, and niche stories — without putting more pressure on already overloaded reporters.

In June, I participated in a fascinating roundtable at Columbia University’s Tow Center for Digital Journalism. It was a gathering of technologists, journalists, academics, and legal scholars discussing the implications of artificial intelligence in the news industry. Many of the questions raised involved whether newsrooms would be hesitant to embrace AI: How can we encourage collaboration between journalists and technologists? How do we change the culture for people to want to do this?

Some reporters may worry about the impact of artificial intelligence on their jobs. They may balk at the idea of an algorithm being able to rapidly write thousands of news stories. But many of the use cases for AI would make reporters’ lives easier and their jobs more fulfilling. For example, the Associated Press worked with firm Automated Insights to increase twelvefold the number of corporate earnings stories it produces. It estimated that it freed up 20 percent of reporters’ time to work on more complex stories. Reuters also produces thousands of automated stories each day, in multiple languages, from corporate and government data.

Meanwhile, The Washington Post used its robot reporter, Heliograf, on Election Day to cover congressional and gubernatorial races. The technology also allows the Post to cover all D.C.-area high school football games every week. BuzzFeed was able to supplement its on-the-ground reporting from last year’s political conventions by deploying a bot that interacted with attendees. These cases show how journalists can benefit from automation helping to expand coverage while freeing reporters up to do higher-level work.

There is evidence that AI may improve the quality of journalism itself. “In the case of automated financial news coverage by AP, the error rate in the copy decreased even as the volume of the output increased more than tenfold,” said Francesco Marconi, who co-leads AP’s automation and artificial intelligence efforts.

Like John Keefe, I expect to see more major scoops next year by reporters using machine learning. The Atlanta Journal-Constitution was a Pulitzer Prize finalist for its yearlong investigation on sexual abuse by doctors. They analyzed more than 100,000 disciplinary documents and other records to find cases that may have involved doctors’ misconduct. They used machine learning to analyze the cases and assigned each case a probability rating, based on keywords, that it was related to sexual abuse.

Local news organizations are essential to their communities, but they struggle to cover them amid layoffs and shrinking newsroom resources. AI could be used to automate some types of local stories, such as crime reports and coverage of school and community board meetings. This would give residents access to more hyperlocal, personalized stories, while freeing up reporters to focus on other projects.

Most newsrooms simply do not have the resources to invest in artificial intelligence. That’s understandable. It’s time consuming, and the payoff may not be immediately apparent. Collaboration will be critical to advance how newsrooms use AI. That could mean a consortium of newsrooms working together on ambitious machine learning projects. Academic institutions have already led much of the research surrounding artificial intelligence, so we could also see more news organizations partnering with universities. However it happens, AI will become increasingly common in newsrooms until it’s seen as an essential part of the reporting process.

Rubina Madan Fillion is the director of audience engagement at The Intercept.

Amy Webb   Listen to weak signals

Heather Bryant   Building the ecosystems for collaboration

Rodney Gibbs   Tech workers turn to journalism

Kyle Ellis   Let’s build our way out of this

An Xiao Mina   Memes and visuals come to the fore

Mandy Velez   texting is lit rn, fam

Helen Havlak   Keywords, not publishers, power the world’s biggest feeds

Trushar Barot   The Jio-fication of India

Richard J. Tofel   The platforms’ power demands more reporters’ attention

Will Sommer   The year local media gets conservative

Debra Adams Simmons   And a woman shall lead them

Imaeyen Ibanga   Longform video leads the way

Kinsey Wilson   Facebook and Google: Help out or pay up

Michael Kuntz   The only pivot that might work

Joyce Barnathan   It will be harder to bury the news

Brian Lam   Sketchy ethics around product reviews

Molly de Aguiar   Good journalism won’t be enough

Alastair Coote   The year of self-improvement

Tracie Powell   The muting of underserved voices

Craig Newmark   Working together toward sustainable solutions

Almar Latour   Conquering calm

Tanzina Vega   It’s time for media companies to #PassTheMic

Ernst-Jan Pfauth   Publishing less to give readers more

Jennifer Brandel and Mónica Guzmán   The editorial meeting of the future

Rachel Davis Mersey   AI, with real smarts

Steve Grove   The midterms are an opportunity

Nushin Rashidian   Publishers seek ad dollar alternatives

Tamar Charney   We get serious about algorithms

Charo Henríquez   Training is an investment, not an expense

Francesco Marconi   The year of machine-to-machine journalism

Tanya Cordrey   Finally, the seeds of radical reinvention

Carrie Brown-Smith   Transparency finally takes off

Luke O'Neil   The end is already here

Michelle Garcia   Navigating journalistic transparency

Daniel Trielli   The rich get richer, the poor scramble

Mario García   Storytelling finally adapts to mobile

Sam Sanders   Shine the light on ourselves

Cindy Royal   Your journalism curriculum is obsolete

Caitlin Thompson   Podcasting models mature and diversify

Zizi Papacharissi   Women come back

Julia B. Chan   Looking for loyalty in all the right places

Jessica Parker Gilbert   Design connects storytelling and strategy

Juliette De Maeyer   A responsible press criticism

Alexios Mantzarlis   Moving fake news research out of the lab

Julia Beizer   A longer view on the pivot

Jennifer Choi   Standing up for us and for each other

Betsy O'Donovan and Melody Kramer   Skepticism and narcissism

Laura E. Davis   Writing answers before you know the question

Nancy Watzman   Know thy TV

Jacqui Cheng   Retailers move into content

Usha Sahay   Wallets get opened

Jesse Holcomb   Information disorder, coming to a congressional district near you

Rodney Benson   Better, less read, and less trusted

Hossein Derakhshan   Television has won

Matt DeRienzo   A recession, then a collapse

Nicholas Quah   Stop talking trash about young people

Matt Carlson   Attacks on the press will get worse

Sarah Marshall   Loyalty as the key performance indicator

Niketa Patel   Live journalism comes of age

Manoush Zomorodi   Self-help as a publishing strategy

John Keefe   Scooped by AI

Edward Roussel   Eyes, ears, and brains

Alan Soon   The rise of start of psychographic, micro-targeted media

Dan Newman   A return to trust

Carlos Martínez de la Serna   The new journalism commons

Vivian Schiller   Pivot to tomorrow

Emily Goligoski   Looking beyond news for inspiration

Ruth Palmer   Risks will grow for news subjects — especially minorities

Pete Brown   Push alerts, personalized

Basile Simon   We need better career paths for news nerds

Monique Judge   Letting black women tell their own stories

Sam Ford   The year of investing in processes

Andrew Losowsky   The year of resilience

Jassim Ahmad   Thriving on change

Rasmus Kleis Nielsen   The Snapchat scenario and the risk of more closed platforms

Jake Levine   The return to now

L. Gordon Crovitz   Serving readers over advertisers

Jarrod Dicker   Honesty in advertising

Bill Keller   A growing turn to philanthropy

Lucas Graves   From algorithms to institutions

Amie Ferris-Rotman   More female reporters abroad (please)

Justin Kosslyn   The year journalists become digital security experts

Cory Haik   Suffering from realness, pivoting to impact

Sally Lehrman   Trust comes first

Susie Banikarim   R.I.P. Pivot to Video (2017–2017)

Kawandeep Virdee   Zines had it right all along

Corey Johnson   The pro-fact resistance

David Skok   Finding an information-life balance

Evie Nagy   Pivot to mobile video frustration

Miguel Castro   The arrival of the impact producer

Jim Moroney   Newspapers have to be good enough for readers to pay for

Pia Frey   Address users as individuals

Nikki Usher   The year of The Washington Post

Burt Herman   Things get real

Matt Thompson   Here come the attention managers

Ray Soto   VR reaches the next level

Dan Shanoff   You down with OTT? (Yeah, DTC)

Kim Fox   Audience teams diversify their approach

Doris Truong   Computer vision vs. the Internet vigilantes

S. Mitra Kalita   The arc of news and audience

Renée Kaplan   The year of quiet adjustments (shhh)

Mi-Ai Parrish   Blockchain and trust

Sue Schardt   Jump the niche

Amy King   Let’s amplify visual voice

Joanne Lipman   Journalists inventing revenue streams

Monika Bauerlein   The firehose of falsehood

Aron Pilhofer   We can’t leave the business to the business side any more

Caitria O'Neill   The new court of public opinion

Eric Ulken   The year local publishers get smart(er) about change

Lanre Akinola   Making noise is not a strategy

Claire Wardle   Disinformation gets worse

Frédéric Filloux   External forces

Tim Carmody   Watch out for Spotify

Elizabeth Jensen   Show your work

Andrew Ramsammy   The year ownership mattered

Mariana Moura Santos   Think local, act global

Lam Thuy Vo   Breaking free from the tyranny of the loudest

Hannah Cassius   The year of the echo-chamber escapists

P. Kim Bui   The reckoning is only beginning

Damon Krukowski   Reviving the alt-weekly soul

Eric Nuzum   Beyond the narrative arc

Mary Meehan   Real lives are at stake in rural areas

Valérie Bélair-Gagnon   Seeking trust in fragmented spaces

Feli Sánchez   The year for guerrilla user research

Marcela Donini and Thiago Herdy   Collaboration is the way forward for Brazilian journalism

Federica Cherubini   The rise of bridge roles in news organizations

Neha Gandhi   Filler killers

C.W. Anderson   The social media apocalypse

Paul Ford   Go global

Millie Tran and Stine Bauer Dahlberg   (Hint: It’s about your brand)

Jamie Mottram   From pageviews to t-shirts

Kathleen McElroy   Building a news video experience native to mobile

Sara M. Watson   Feeds will open up to new user-determined filters

Vanessa K. DeLuca   Women’s voices take center stage

Rick Berke   Value is the watchword

Matt Boggie   The intellectual equivalent of the Dead Sea

Rachel Schallom   Better design helps differentiate opinion and news

Ståle Grut   Reclaiming audience interaction from social networks

Michelle Ferrier   The year of the great reckoning

Felix Salmon   Covering bitcoin while owning bitcoin

Ariana Tobin   Too tired to tap

Christopher Meighan   Passive partnership is in the rearview

Marie Gilot   No assholes allowed

Mira Lowe   The year of the local watchdog

Juleyka Lantigua-Williams   Women of color will reclaim and monetize our time

Mary Walter-Brown   Show a little vulnerability

Pablo Boczkowski   The rise of skeptical reading

Alice Antheaume   Are you fluent in AI?

Taylor Lorenz   Social and media will split

Jennifer Coogan   The future is female

Dannagal G. Young   Stop covering politics as a game

Borja Echevarría   TV goes digital, digital goes TV

Dheerja Kaur   Fun with subscription products

Mike Caulfield   Refactoring media literacy for the networked age

Raney Aronson-Rath   Transparency is the antidote to fake news

Jim Brady   With the people, not just of the people

Joanne McNeil   Gatekeeping the gatekeepers

Rubina Madan Fillion   Unlocking the potential of AI

Jared Newman   Venture funding and digital news don’t mix

Raju Narisetti   Mirror, mirror on the wall

Mariano Blejman   News games rule

Kelsey Proud   No, no, no

Kristen Muller   The year of the voter

Nicholas Diakopoulos   Fortifying social media from automated inauthenticity

Emma Carew Grovum   Newsroom culture becomes a priority

Cristina Wilson   The year of the Instagram Story

Umbreen Bhatti   The trust problem isn’t new

Nathalie Malinarich   Peak push

José Zamora   Revenue-first journalism

Adam Thomas   Sharing is caring: The year of the mentor

Andrew Haeg   The year journalists become relationship builders

Alfred Hermida   Going beyond mobile-first

Yvonne Leow   The rise of video messaging

Sydette Harry   Listen to your corner and watch for the hook

Errin Haines Whack   At the ballot, it’s time to count black women

Corey Ford   The empire strikes back