Nieman Foundation at Harvard
HOME
          
LATEST STORY
“This puts Black @nytimes staff in danger”: New York Times staffers band together to protest Tom Cotton’s anti-protest op-ed
ABOUT                    SUBSCRIBE
July 18, 2019, 7:15 a.m.
Audience & Social

Hey comment mods, you doin’ okay? A new study shows moderating uncivil comments reduces the moderator’s trust in news

“The toll of moderating uncivil comments may be much stronger for moderators putting in several hours or a full day.”

Moderating the online world is hard. (Casey Newton’s investigations at The Verge, looking into the quality of life of contractors tasked with reviewing toxic content for Facebook and other platforms, highlight some of many tragic and downright bizarre content moderation workplace incidents.)

Moderating the online world of journalism is hard work, too. A new study from the Center for Media Engagement shows that people moderating uncivil comments on news sites decreases their trust in the news outlet and increases their emotional exhaustion. And that’s just 747 participants from Mechanical Turk who spent an average of 24 minutes doing it — not even a survey of the people who are actually paid to do this stuff all day.

“The toll of moderating uncivil comments may be much stronger for moderators putting in several hours or a full day,” researchers Martin J. Riedl, Gina Masullo Chen, and Kelsey N. Whipple wrote in their findings. “They may have a better experience on the job if they moderate a mix of civil and uncivil comments, rather than focusing exclusively on uncivil content. We also suggest comment moderators be given other tasks, along with comment moderation, to improve the experience.”

Those who had moderated only uncivil comments in the experiment reported a score of 3.61 on a 0-7 scale with 7 being Ultimate Cronkite levels of trust in news; “our results suggest that moderating only uncivil comments diminishes perceived trust in a news outlet,” they wrote.

The emotional toll was also higher for uncivil-comment moderators compared to those tackling both civil and uncivil or only civil comments.

(The researchers used real comments — presented without brand-name context — from Breitbart, MSNBC, The New York Times, and Yahoo and defined uncivil comments as those including profanity, insults, name-calling, or CAPSLOCK.)

The mere presence of uncivil comments can really cloud a person’s perception of a news site, CME researchers have previously found; so it does make a difference if you have a comments section to have someone there fighting the good fight:

Researchers at the Center for Media Engagement at the University of Texas found that uncivil comments on news stories can cloud a visitor’s perspective of a news site — even if more civil comments are presented first.

Experiments with more than 1,500 testers showed that people who only saw uncivil comments had diminished loyalty, value, and overall positive attitudes toward the news site in question. Readers who encountered majority-civil comments weren’t as disheartened, but with the internet these days, that can be a hurdle.

“Merely starting a comment [section] with civil comments is not enough,” wrote Gina Masullo Chen, Shuning Lu, and Ori Tenenboim in the study’s report.

That built on the work of a study from LSU published in November that showed your credibility, in readers’ eyes, can be seriously whacked by commenter attacks — spilling over from those fine folk who write them:

Our results suggest that incivility in comment sections can influence how people perceive a news organization’s brand — which is key to attracting an audience. The study shows that news organizations would benefit from improving comment sections. Some organizations have tried to deter incivility by encouraging journalists to highlight comments that are civil and thoughtful or to post the first comment to set a positive tone for a comment thread. These practices are worthy, but they may not be enough. News organizations should focus on the whole comment stream or at least the parts that are visible when people visit the site.

So yes, the comments section does matter, and so does having someone involved down there. Just make sure they’re doing okay, too. Remember: Women tend to face more abuse online than men, regardless of their role online, though the credibility swings affect everyone. (And also remember: Is trust in news the core problem, or is the way news makes people feel?)

Cartoon by XKCD used under a Creative Commons license.

POSTED     July 18, 2019, 7:15 a.m.
SEE MORE ON Audience & Social
SHARE THIS STORY
   
 
Join the 50,000 who get the freshest future-of-journalism news in our daily email.
“This puts Black @nytimes staff in danger”: New York Times staffers band together to protest Tom Cotton’s anti-protest op-ed
“It has never been my expectation that every piece the New York Times publishes will confirm my personal worldview, but it was also never my expectation The Times would run an op-ed calling for state violence.”
The Philadelphia Inquirer’s journalists of color are taking a “sick and tired day” after “Buildings Matter, Too” headline
“We’re tired of shouldering the burden of dragging this 200-year-old institution kicking and screaming into a more equitable age.”
VizPol takes a cue from bird-watching apps to help journalists identify unfamiliar political symbols
Built by researchers at Columbia University’s journalism and engineering schools and launched as an invite-only beta this week, VizPol can currently recognize 52 symbols.