HOME
          
LATEST STORY
U.S. journalists, the clock is ticking: January 31 is the deadline to apply for a Nieman Fellowship
ABOUT                    SUBSCRIBE
March 23, 2011, 6:54 p.m.

Google News de-indexing Berkleyside: Bug, not snub!

You may have seen a blog post making its way around Twitter today: Lance Knobel, publisher of the respected local news site Berkeleyside (and past Lab contributor), noting the fact that Google News had suddenly stopped indexing Berkleyside articles. Headlined “Local news: we’re at Google’s mercy,” the post observed that Google News had stopped indexing Berkeleyside’s stories last Saturday.

Knobel wasn’t the only one who’d noticed an indexing problem. Over at Google’s troubleshooting forum for Google News publishers, complaints like nextgeneric‘s (“Google News refuses to tell me what I can do to get picked up again“) and jwuerfel‘s (“Up Articles not posting now“) were common, particularly over the last few days. Some speculated that their articles weren’t showing up in Google News because, in one of its periodic reviews of its news sites, Google had purged them from its database. As the speculation moved from the discussion board to Twitter, some simply expressed indignation at Berkleyside’s fall from Google grace. As Dan Gillmor put it: “Google News de-indexes local Berkeley site (founders include several former pro journalists), and no one knows why.”

Well, now we know why. A Google representative gave us the short — and, relative to the conspiracy theories, boring — answer: Not a purge, just a bug. Yes, Google News had indeed stopped indexing some local sites, but it was a glitch in the system, not a conscious choice. As Google’s Jeannie Hornung told me in an email:

Google News experienced technical difficulties that may have prevented the indexing of recent articles from some news sources. We believe all issues have been resolved. We apologize to our users and the sites affected.

So, case closed. It’s interesting to note, though, the passion with which people reacted to the notional axing of Berkleyside. (On Twitter alone, Knobel’s post got attention from the likes of David Carr, Felix Salmon, and Dave Winer.) More to the point, it’s understandable: Local news publishers often have odds, financial and otherwise, stacked against them. For many, a presence on Google News is a valuable — even invaluable — way for their work to get exposure and traction. (Many of them are competing, after all, with Patch sites, which have AOL’s mighty infrastructure to back them up.)

“Fortunately,” Knobel noted in his post, “there are many ways for people to find their way to Berkeleyside — the Chronicle is a firehose for traffic, Google search still indexes us, Twitter is wonderful, a nice number of people use our iPhone app, and we have a loyal following. But we’re a news site, damn it, and we want and expect to be indexed as such.”

POSTED     March 23, 2011, 6:54 p.m.
SHARE THIS STORY
   
Show comments  
Show tags
 
Join the 15,000 who get the freshest future-of-journalism news in our daily email.
U.S. journalists, the clock is ticking: January 31 is the deadline to apply for a Nieman Fellowship
It’s a chance to spend a year at Harvard and change the shape of your career.
Newsonomics: How deep is the newspaper industry’s money hole?
Forget keeping up with the economy — what would it take for the newspaper business just to keep up with inflation? Even the “growth” areas are slowing down.
Don’t try too hard to please Twitter — and other lessons from The New York Times’ social media desk
The team that runs the Times’ Twitter accounts looked back on what they learned — what worked, what didn’t — from running @NYTimes in 2014.
What to read next
1510
tweets
Don’t try too hard to please Twitter — and other lessons from The New York Times’ social media desk
The team that runs the Times’ Twitter accounts looked back on what they learned — what worked, what didn’t — from running @NYTimes in 2014.
692Q&A: Amy O’Leary on eight years of navigating digital culture change at The New York Times
“In 2007, as digital people, we were expected to be 100 percent deferent to all traditional processes. We weren’t to bother reporters or encourage them to operate differently at all, because what they were doing was the very core of our journalism.”
544How do you get millennials to care about local news? The Charlotte Observer is testing out one idea
Its new website and newsletter Charlotte Five is an attempt to use lessons from viral publishers to find a spot in young people’s daily habits.
These stories are our most popular on Twitter over the past 30 days.
See all our most recent pieces ➚
Encyclo is our encyclopedia of the future of news, chronicling the key players in journalism’s evolution.
Here are a few of the entries you’ll find in Encyclo.   Get the full Encyclo ➚
WyoFile
Dallas Morning News
Mother Jones
New Haven Independent
MediaBugs
Gannett
MediaNews Group
Voice of San Diego
Minneapolis Star Tribune
The Atlantic
FactCheck.org
Apple