HOME
          
LATEST STORY
Opening up the archives: JSTOR wants to tie a library to the news
ABOUT                    SUBSCRIBE
Aug. 13, 2009, 8:37 a.m.

How The Associated Press will try to rival Wikipedia in search results

Yesterday we revealed plans by The Associated Press to hold back some content from member websites. (Great discussion going on there, by the way.) The primary motivation of that initiative is search: AP material that resides on hundreds of disparate sites at the same time will hardly rate in Google compared to a single page with hundreds of links pointing to it. That’s a fundamental tenet of search engine optimization.

The same philosophy is driving their plan to build “news guide landing pages” that will aggregate the AP’s content around subjects, places, organizations, and people. Think of the topic pages on sites like The Chicago Tribune, BBC, and others — except that the AP will be harnessing its vast network of members and customers in what could amount to a brilliant SEO play.

The landing pages were first mentioned at the AP’s annual meeting in April, but further details haven’t emerged until now. In material distributed to some members last month, the news guide is described as “a central location to which headlines, promotional products and other content developed by AP could point.” What that will mean in practice is similar to what you find in the digital content of other news organizations: All references in AP articles to, say, Bill Clinton would link to the landing page with aggregated content and other material about the former president.

But, of course, those links to the landing pages would come from member news sites with excellent PageRank, the key metric used by Google to determine search results. (For instance, CNN, which carries AP content, has the maximum and extremely rare PageRank of 10.) It’s easy to see how the AP’s landing pages could, in short order, shoot up near the top of results for popular, news-related search terms.

Competing with Wikipedia

The document that I referenced yesterday, the one labeled “AP CONFIDENTIAL — NOT FOR DISTRIBUTION,” includes four pages of sharp, if widely accepted, analysis of how news is consumed today. Referring to coverage of Michael Jackson’s death, it says:

Two of the biggest beneficiaries of that traffic bonanza were Twitter and Wikipedia, a couple of digital natives that would have been viewed as very unlikely news competitors even a few months ago. Indeed, a new pattern of consumption was validated in the confusing minutes that followed the first reports of Jacko’s death: Users shared; they searched and they clicked on Wikipedia….

The Wikipedia page on Michael Jackson is not very pretty to look at, but it has more blue hyperlinks than black type. Forget the “wiki” method of community updating, the key to Wikipedia’s success is that its pages are designed to catch traffic, provide key information and then send users on their way to deeper engagement on the subjects they’re interested in.

(According to Wikipedia traffic statistics, the site’s Michael Jackson page has been viewed more than 24 million times since his death.)

There’s further discussion of Wikipedia’s dominance in search results, which is a product of all the external links pointing to Wikipedia and a variety of other factors. As Mathieu O’Neil Sage Ross, the editor of in-house newsletter Wikipedia Signpost, told me yesterday, “Google juice goes in, swishes around, doesn’t come out.” And that’s clearly what the AP would like to emulate, although it’s less clear how they’ll generate many links beyond member and customer sites. The document states flatly, “The Wikipedia model of standing, authoritative pages could be challenged.”

Proof of concept

Most of the AP’s landing pages would be automatically generated, although “editorial curation” would also be possible. That’s the model followed by sites like The New York Times, which has had decent success with Times Topics. In an internal memo late last year, Times editors boasted, “Many months of SEO labor…helped promote our Credit Crisis page to the prominence it deserves; search for “credit crisis” on Google and our Topic Page comes up first.” (It should be noted, though, that the Times page has been passed since that memo; it currently ranks behind The Crisis of Credit, a terrific 11-minute video describing credit concepts made by a young man named Jonathan Jarvis as part of his master’s thesis at a design college. Take from that what you will.)

The AP is also hoping it can convince members to join the project and have their content aggregated on the landing pages as well. (Of course, plenty of websites, citing fair use, do that already without any formal partnership.) The material distributed last month notes that the landing pages could “facilitate paid distribution of AP and member content,” although I don’t get the sense that’s a priority. As with the strategy I described yesterday, there’s a real question of balance here: It’s obvious what the AP gains, but members will obviously want to know what’s in it for them.

An SEO firm called EveryZing recently produced a trial run of the AP’s landing pages, according to their vice president for client services and business development, Bob Fogarty. EveryZing has also created topic pages for Fox News and Newsweek. In the latter case, the project is actually called…Newsweekopedia.

Much of this strategy follows what Google vice president Marissa Mayer suggested in recent testimony to Congress. It’s also in line with the research of Matt Thompson, whose currently online community manager at the Knight Foundation. And I wrote about these ideas when Google News began including Wikipedia in its search results.

POSTED     Aug. 13, 2009, 8:37 a.m.
PART OF A SERIES     AP’s online strategy
SHARE THIS STORY
   
Show comments  
Show tags
 
Join the 15,000 who get the freshest future-of-journalism news in our daily email.
Opening up the archives: JSTOR wants to tie a library to the news
Its new site JSTOR Daily highlights interesting research and offers background and context on current events.
Six fresh ideas for news design from a #SNDMakes designathon
New media and legacy media came together at the second weekend-long “hackathon” hosted by the Society for News Design.
Where you get your news depends on where you stand on the issues
A new study by the Pew Research Center examines how Americans’ news consumption habits correlate with where they fall on the political spectrum.
What to read next
1020
tweets
The newsonomics of the millennial moment
The new wave of news startups is aiming at a younger audience. But do legacy media companies have a chance at earning their attention?
803A mixed bag on apps: What The New York Times learned with NYT Opinion and NYT Now
The two apps were part of the paper’s plan to increase digital subscribers through smaller, targeted offerings. Now, with staff cutbacks on the way, one app is being shuttered and the other is being adjusted.
537Watching what happens: The New York Times is making a front-page bet on real-time aggregation
A new homepage feature called “Watching” offers readers a feed of headlines, tweets, and multimedia from around the web.
These stories are our most popular on Twitter over the past 30 days.
See all our most recent pieces ➚
Encyclo is our encyclopedia of the future of news, chronicling the key players in journalism’s evolution.
Here are a few of the entries you’ll find in Encyclo.   Get the full Encyclo ➚
Iowa Center for Public Affairs Journalism
The Miami Herald
The Blaze
PolitiFact
Dallas Morning News
Global Voices
Hearst
Foreign Policy
Chicago News Cooperative
WikiLeaks
The Huffington Post
Spot.Us