Nieman Foundation at Harvard
HOME
          
LATEST STORY
Should it stay or should it go: News outlets scramble to cover Britain’s decision to exit the European Union
ABOUT                    SUBSCRIBE
Nov. 13, 2014, 1:16 p.m.
LINK: blog.pastpages.org  ➚   |   Posted by: Joshua Benton   |   November 13, 2014

Hopefully you know about PastPages, the tool built by L.A. Times data journalist Ben Welsh to record what some of the web’s most important news sites have on their homepage — hour by hour, every single day. Want to see what The Guardian’s homepage looked like Tuesday night? Here you go. Want to see how that Ebola patient first appeared on DallasNews.com in September? Try the small item here. It’s a valuable service, particularly for future researchers who will want to study how stories moved through new media. (For print media, we have physical archives; for digital news, work even a few years old has an alarming tendency to disappear.)

Anyway, Ben is back with a new tool called StoryTracker, “a set of open source tools for archiving and analyzing news homepages,” backed in part by the Reynolds Journalism Institute at Mizzou.

It offers a menu of options, documented here, for creating an orderly archive of HTML snapshots, extracting hyperlinks with a bonus set of metadata that captures each link’s prominence on the page and visualizing a page’s layout with animations that show changes over time.

The potential uses for researchers are obvious, but I could also imagine plenty of realtime uses. Tracking your own homepage over time, you could get good data on how the granular movement of stories there correlates with traffic over time. (To ask questions like: Is the top slot more or less valuable on weekends or overnight than during the day Monday to Friday?) You could track your competition’s homepages to get hard data on what stories they’re pushing hardest. And unlike the base PastPages, which saves screenshots of homepages, StoryTracker gets at the HTML to determine what stories are where. It’s all open source, so have at it. (Here’s a sample analysis to see what sources the Drudge Report links to most.)

Ben presented StoryTracker at a conference at RJI earlier this week; here’s the video and his slide deck.

Show tags Show comments / Leave a comment
 
Join the 15,000 who get the freshest future-of-journalism news in our daily email.
Should it stay or should it go: News outlets scramble to cover Britain’s decision to exit the European Union
Online, readers stayed up for the results: Peak traffic to BBC News, for instance, was around 4 a.m. GMT, and by 11 a.m. BBC.com had received 88 million page views.
Acast wants to get new audiences “in the podcast door” with more diverse shows and better data
With a new paid subscription option and its sights set on non English-speaking countries, the Swedish podcasting startup is looking for listeners (and shows) beyond the iTunes set.
“Medium’s team did everything”: How 5 publishers transitioned their sites to Medium
What happened when Pacific Standard, The Ringer, The Awl, The Bold Italic, and Femsplain moved their sites over to Medium.
What to read next
0BuzzFeed’s Another Round podcast is partnering with a social audio app to let listeners submit their stories
The podcast is working with the app, Rolltape, to make it easier for listeners to submit their own audio.
0In 60 days, drone journalism will be legally possible in any U.S. newsroom
“There are still challenges, and we haven’t even talked about state and local laws that have been piling up while the FAA lumbered toward today. But the future of drones in journalism is much brighter today than it has ever been.”
0Honolulu Civil Beat, after six years of trying life as a for-profit, is becoming a nonprofit after all
The Pierre Omidyar-backed news site is dropping its paywall and launching a membership program as part of the change.
Fuego is our heat-seeking Twitter bot, tracking the links the future-of-journalism crowd is talking about most on Twitter.
Here are a few of the top links Fuego’s currently watching.   Get the full Fuego ➚
Encyclo is our encyclopedia of the future of news, chronicling the key players in journalism’s evolution.
Here are a few of the entries you’ll find in Encyclo.   Get the full Encyclo ➚
Hechinger Report
GateHouse Media
New West
Flipboard
The Daily Voice
Charlottesville Tomorrow
Animal Político
Slate
The Ann Arbor Chronicle
Houston Chronicle
Current TV
Chicago News Cooperative