HOME
          
LATEST STORY
Where you get your news depends on where you stand on the issues
ABOUT                    SUBSCRIBE
March 19, 2013, 10 a.m.

From Nieman Reports: The value Consumer Reports gets from the Internet’s consumer retorts

“If you rely only on user reviews to make your purchases, you’re on your own to figure out how to synthesize dozens of discordant comments. Does one super-negative review annul numerous glowing squibs? Do 10 positive reviews mean a product is likely worth buying?”
Editor’s note: Our colleagues at our sister publication Nieman Reports are out with their new issue, and there’s a lot of great stuff in there for any journalist to check out. Over the next few days, we’ll share excerpts from a few of the stories that we think would be of most interest to Nieman Lab readers. Be sure to check out the entire issue.

Here, Kimberly D. Kleman, editor-in-chief of Consumer Reports, notes how her magazine has used the explosion of user reviews online to find ways to add value to their work.

nieman-reports-winter-2013Greetings from 50 testing labs humming with spinning washers and dryers; illuminated with newfangled light bulbs and supersized TVs; ambrosial with the aroma of hundreds of just-baked cookies from dozens of ranges and wall ovens; chilly from the steady blast of room air conditioners; striped and splattered from assessments of paints and stains; and buzzing with trained tasters sampling chocolates or beef jerky or sparkling wine. In other words, the Yonkers, New York headquarters of Consumer Reports, which puts to the test more than 3,000 consumer products each year.

I know, I know. That sounds nothing like your newspaper, magazine, Web operation or the spare bedroom where you write your reviews. But an important lesson Consumer Reports has learned from user reviews — namely, how to use them to become stronger — is applicable to a range of professional reviewers, I believe.

You might think that an organization like ours would react in one of two predictable ways to the proliferation of user reviews you can now find for pretty much anything you want to buy:

Dismiss them as trivial and unscientific. After all, we’re the organization that spends more than $7 million each year buying not only products — from Audi sports sedans to ZVOX home theater systems — but also making or buying the testing equipment and sourcing ancillary supplies. The latter includes cotton swatches identically stained with chocolate ice cream, grass, sebum, and other blots to assess laundry detergents; Maine Coon cat fur to test the pet-hair pickup claims of vacuums; cherry-pie filling, eggs, and tapioca we use to create the “monster mash” we paint on the innards of ovens to rate their self-cleaning claims, and much more. Compare that level of testing rigor to Concepcionz and her five-star impressions on Amazon.com of her American Standard elongated two-piece toilet: “The product arrived as described, pretty good price and it arrived very safe….Everything is as described and I love the product.”

Keep reading at Nieman Reports »

POSTED     March 19, 2013, 10 a.m.
SHARE THIS STORY
   
Show comments  
Show tags
 
Join the 15,000 who get the freshest future-of-journalism news in our daily email.
Where you get your news depends on where you stand on the issues
A new study by the Pew Research Center examines how Americans’ news consumption habits correlate with where they fall on the political spectrum.
Light everywhere: The California Civic Data Coalition wants to make public datasets easier to crunch
Journalists from rival outlets are pursuing the dream of “pluggable data,” partnering to build open-source tools to analyze California campaign finance and lobbying data.
Ebola Deeply builds on the lessons of single-subject news sites: A news operation with an expiration date
Following the blueprint of Syria Deeply, the new Ebola-focused site hopes to deliver context and coherence in covering the spread and treatment of the virus.
What to read next
1020
tweets
The newsonomics of the millennial moment
The new wave of news startups is aiming at a younger audience. But do legacy media companies have a chance at earning their attention?
803A mixed bag on apps: What The New York Times learned with NYT Opinion and NYT Now
The two apps were part of the paper’s plan to increase digital subscribers through smaller, targeted offerings. Now, with staff cutbacks on the way, one app is being shuttered and the other is being adjusted.
537Watching what happens: The New York Times is making a front-page bet on real-time aggregation
A new homepage feature called “Watching” offers readers a feed of headlines, tweets, and multimedia from around the web.
These stories are our most popular on Twitter over the past 30 days.
See all our most recent pieces ➚
Encyclo is our encyclopedia of the future of news, chronicling the key players in journalism’s evolution.
Here are a few of the entries you’ll find in Encyclo.   Get the full Encyclo ➚
BBC News
Salon
Media Consortium
Foreign Policy
I-News
Time
Sacramento Press
FactCheck.org
Hechinger Report
MinnPost
The Huffington Post
Animal Político