Nieman Foundation at Harvard
HOME
          
LATEST STORY
With a scripted daily comedy news show, Mic looks to add a little late night TV to the social video mold
ABOUT                    SUBSCRIBE
March 19, 2013, 10 a.m.

From Nieman Reports: The value Consumer Reports gets from the Internet’s consumer retorts

“If you rely only on user reviews to make your purchases, you’re on your own to figure out how to synthesize dozens of discordant comments. Does one super-negative review annul numerous glowing squibs? Do 10 positive reviews mean a product is likely worth buying?”
Editor’s note: Our colleagues at our sister publication Nieman Reports are out with their new issue, and there’s a lot of great stuff in there for any journalist to check out. Over the next few days, we’ll share excerpts from a few of the stories that we think would be of most interest to Nieman Lab readers. Be sure to check out the entire issue.

Here, Kimberly D. Kleman, editor-in-chief of Consumer Reports, notes how her magazine has used the explosion of user reviews online to find ways to add value to their work.

nieman-reports-winter-2013Greetings from 50 testing labs humming with spinning washers and dryers; illuminated with newfangled light bulbs and supersized TVs; ambrosial with the aroma of hundreds of just-baked cookies from dozens of ranges and wall ovens; chilly from the steady blast of room air conditioners; striped and splattered from assessments of paints and stains; and buzzing with trained tasters sampling chocolates or beef jerky or sparkling wine. In other words, the Yonkers, New York headquarters of Consumer Reports, which puts to the test more than 3,000 consumer products each year.

I know, I know. That sounds nothing like your newspaper, magazine, Web operation or the spare bedroom where you write your reviews. But an important lesson Consumer Reports has learned from user reviews — namely, how to use them to become stronger — is applicable to a range of professional reviewers, I believe.

You might think that an organization like ours would react in one of two predictable ways to the proliferation of user reviews you can now find for pretty much anything you want to buy:

Dismiss them as trivial and unscientific. After all, we’re the organization that spends more than $7 million each year buying not only products — from Audi sports sedans to ZVOX home theater systems — but also making or buying the testing equipment and sourcing ancillary supplies. The latter includes cotton swatches identically stained with chocolate ice cream, grass, sebum, and other blots to assess laundry detergents; Maine Coon cat fur to test the pet-hair pickup claims of vacuums; cherry-pie filling, eggs, and tapioca we use to create the “monster mash” we paint on the innards of ovens to rate their self-cleaning claims, and much more. Compare that level of testing rigor to Concepcionz and her five-star impressions on Amazon.com of her American Standard elongated two-piece toilet: “The product arrived as described, pretty good price and it arrived very safe….Everything is as described and I love the product.”

Keep reading at Nieman Reports »

POSTED     March 19, 2013, 10 a.m.
SHARE THIS STORY
   
Show comments  
Show tags
 
Join the 15,000 who get the freshest future-of-journalism news in our daily email.
With a scripted daily comedy news show, Mic looks to add a little late night TV to the social video mold
“We don’t just present a bunch of headlines and say what we think. Our videos are chock-full of facts and research.”
Hoping to redefine “trade publication,” Digiday launches Glossy, a vertical to cover disruption in fashion
“I hate the term ‘trade publication,’ because it implies being a boring cheerleader for the industry.”
The Wall Street Journal website — paywalled from the very beginning — turns 20 years old today
“From the very beginning it was very clear we needed to cover all the same concerns and sensibilities of the print Journal even though we were online and even though we were a young staff.”
What to read next
0
tweets
How Atlas Obscura helps its web audience discover the real world
Events like its upcoming Obscura Day are meant to help the site’s digital readers discover places they previously only read about.
0Inspired by “independent YouTubers,” wary of cable, Vox.com takes its explainer mission to video
“I made one rule starting out: No desks.”
0You can now get personalized Breaking News alerts on Slack
The NBC-owned company’s new Slack bot lets you follow more than 90,000 topics.
These stories are our most popular on Twitter over the past 30 days.
See all our most recent pieces ➚
Encyclo is our encyclopedia of the future of news, chronicling the key players in journalism’s evolution.
Here are a few of the entries you’ll find in Encyclo.   Get the full Encyclo ➚
O Globo
Ann Arbor News
Media Consortium
The UpTake
Amazon
Medium
Next Door Media
The Times of London
NBC News
WikiLeaks
Outside.in
The Atlantic