Twitter  This Week in Review: Facebook thinks they have the formular for cracking down on clickbait  
Nieman Journalism Lab
Pushing to the future of journalism — A project of the Nieman Foundation at Harvard
Busted computer in the desert

Four reasons why an open-source newsroom is harder than it looks: Lessons from Al Jazeera

Open-source may be hip, but an awful lot of cultural baggage can get in the way of newsrooms adopting it.

Busted computer in the desert

Editor’s Note: Nikki Usher and Seth C. Lewis are academic researchers studying the intersection of journalists and technologists, or “hacks and hackers.” The latest part of their work included Usher’s two-week visit to Doha, Qatar, in June to study how this phenomenon is playing out at Al Jazeera English.

DOHA, Qatar — Open-source software might at first seem easy for a news organization to get behind: It’s owned by no one, improved by everyone, and costs nothing to acquire.

At Al Jazeera, the network’s top voices have advocated open-source for years. Al Jazeera English was an early partner of the Knight-Mozilla News Technology Partnership, now OpenNews. The Drupal-powered live blogs at AJE captured more traffic during the Egyptian uprisings, at times, than the main website. And within the past year, Al Jazeera launched the Drupal-based Al Jazeera Balkans site and plans to use Drupal for the forthcoming Al Jazeera Turkey site.

But after visiting the AJE newsroom this summer, it became apparent the much-heralded open-source movement was a lot more complicated, despite Al Jazeera’s advances. The internal debate at Al Jazeera mirrors what is often a larger conversation about the merits between proprietary and open-source technology. Using Al Jazeera as a case study, we can draw some larger lessons about the challenges facing open-source in the newsroom.

1. Open-source may not be widely understood by the newsroom

As Moeed Ahmad, head of new media for the network, explained to me, open-source is often equated with “hackable” — and not in the good way. At Al Jazeera, hacking is a real concern: Syria launches regular, if not daily, server attacks on Al Jazeera servers, and there are dozens of unfriendly countries and groups that would love to exploit Al Jazeera’s content. Still, as Ahmad noted, “Open-source is quite remarkable…really, if you talk to other people, Windows is not so secure.”

Ahmad and others pointed to the fact that Windows has a long history of hacker malfeasance. Open-source, however, seemed safer in his view because thousands of eyes are patrolling not just for bad code but security holes. Open-source, he argued, might be more secure.

Proponents of open-source in the newsroom also face another misunderstanding: that open-source equals free labor and require zero upkeep. This could lead to a lack of dollars to invest in maintenance and support.

Dick Olsson, the lead (and only) Drupal developer for Al Jazeera English, kept reminding me of the Richard Stallman maxim: “Free as in speech, not as in beer.” There may be no cost to acquire open-source software, but someone has to install and maintain it.

The question, then, becomes whether newsrooms are going to shoulder the necessary operations costs to go open-source, and whether an open-source content-management system offers enough benefits to outweigh running a proprietary system.

As Ahmad and Olsson acknowledged, the costs for both may actually be the same, but the benefits of access to a wider open-source community made them advocates for the newsroom. Despite the supporters at Al Jazeera English, there were no signs the entire site would move to open-source any time soon.

2. Proprietary systems are well-entrenched in newsrooms

At Al Jazeera English, in-house developers have built a proprietary CMS and tinkered with it for the better part of a decade. These are dedicated developers who know every bug in the system. (Talk about job security.) If it ain’t broke, they argue, don’t fix it. And if it is broke, these guys (at Al Jazeera, it’s almost all dudes) know how to fix it. When Nikki spoke to some of them, they resisted the idea of running an open-source CMS in the newsroom.

To them, open-source means leaving “development up to a community who decides when they want to build things for you,” explained one senior developer who did not want to be named to protect his job.

Inside Al Jazeera, there was a team of eight or so developers who had built the CMS from scratch. These developers were attached to their product and convinced that what they had was more finely attuned to the needs of the newsroom.

A CMS change, for better or worse, is a big change for the newsroom, and those who might lead the technical support for switching the entire system had little interest in doing so.

3. Relying on the open-source community for development may not be practical

There are only a few projects running on open-source platforms at Al Jazeera: two Arabic-language projects, Sharek (a citizen sharing site) and Mubasher (a C-SPAN for the Arab world); the live blogs run by Al Jazeera English; an Arab history project; and the Creative Commons news site. Is there enough support for these sites to scale up to something big?

As Olsson explained to me, it’s going to take a lot for Al Jazeera English, for example, to run solely on Drupal.

“For an organization, the open-source community is not sufficient to rely on for support for the long-term return on investment,” he said. “The day-to-day needs are not covered by the community, so more open-source developers are needed in-house for products. In some cases, we use a third-party platform or host. Al Jazeera has to spend money because it doesn’t have enough people in house with LAMP stack competence.”

In his view, there simply weren’t enough resources for Al Jazeera to try to work with open-source full-time. Going outside Al Jazeera would require money, but he’d fall back into the trap of managers who didn’t understand that they had to pay for support because open-source support is not free.

The software developer quoted above complained to me there weren’t enough resources from the open-source community specifically geared toward news. “It’s unpredictable. Those libraries are out there but are for e-commerce, not news.”

During this part of our conversation, some of the Windows-focused software developers asked me to hunt around for examples of open-source CMS elsewhere — that is, a newsroom whose entire content-management system is open-source.

We did but didn’t find very many. The website features Savannah Now, the New York Observer, The Economist, Mother Jones, Fast Company, Slate France, and France 24 (as well as some Scandinavian news organizations we don’t recognize). Notably, France 24’s website has been open-source almost since its inception in 2006 — and it’s a part of the newsroom’s technology-oriented philosophy.

Other examples from mainstream media of open-source include the use of WordPress for blog software at The New York Times, CNN, Reuters, and elsewhere, as well as smaller Tribune Co. properties, including some of the Tribune’s local sites.

It remains an open question whether there are indeed enough resources for developers to reliably build on existing open-source news platforms. The Knight-Mozilla OpenNews challenge has created buzz about open-source and news, but are there really enough casual developers who care to engage with open-source journalism development?

4. There might simply not be the talent — or the culture

Ahmad was sad to report he had trouble persuading anyone at DrupalCon to take advantage of the tax-free palm-tree life in Doha. In the Middle East, especially, the culture of open-source has been shunned in favor of proprietary systems, according to Ahmad, Olsson, and others. In Jordan and Tunisia, the open-source friendly Hacks/Hackers even goes by another name, Media Innovation Initiative, in part because open-source and hacking carry such negative connotations. In Doha and other parts of the Middle East, it might be impossible to find open-source programmers to work for news organizations.

This leads me to think about the backchannel gossip that newsrooms, aside from the big fancy ones, can’t find enough programmer-journalists — let alone get people into their newsrooms to work on open-source. Olsson wasn’t drawn to Al Jazeera because it was a news site: “I came here for the Drupal challenge,” he told me. One wonders if there are enough talented open-source developers who want to work for newsrooms even outside the context of the Middle East.

At Al Jazeera, there were a lot of good arguments from people about why open-source would be beneficial to their newsroom — from security to prototyping to the value of the open-source community. We know these arguments. But it’s important to step back and think about why open-source might be harder than the hype might suggest.

Photo of a busted computer in the desert by Jasson Steffan used under a Creative Commons license

What to read next
Mark Coddington    Aug. 29, 2014
Plus: Concerns about biased news and social media in Ferguson, a Pew study on what we don’t talk about online, and the rest of the news in journalism and tech.
  • FigMow

    Dude realyl does seem to know what he is talking about.

  • Dave

    Good story.  People outside the small world of news publishing systems under-estimate the demands and peculiarities of the business.  You touch on many of them.

  • Sander Maasik

    I really loved this story. Thanks

  • Barry

    So to sum up the four reasons:

    1. Some people might think that open-source is more hackable than Windows, but is actually probably safer. Some people might think that using open source means you no longer have to pay developers.

    2. Developing a proprietary in-house CMS – whatever its quality – means that its developers can effectively hold the company to ransom, because they are the only ones in the world who understand it.

    3. With open-source, some development must be done internally. With an in-house CMS, all development must be done internally. But some people may think that using open-source means that no development must be done internally.

    4. It may be difficult to find good programmers. Just for open-source of course. Not for proprietary systems. Oh, no.

    Or to sum it up even more simply, open-source may not be a good idea because some people don’t take the time to understand what it is and what it isn’t. Or because open-source adoption works against certain vested interests.

  • Thomas Erickson

    A well composed article.  Thanks.   Years of organizations making a simple proprietary product vs in house custom build decision has oriented thinking to a black and white perspective.  Either the proprietary system works for you, or you should build a custom system.

    Open source, specifically Drupal, does not work like that.   You can choose to use it as a 100% solution a la a proprietary system, or you can use it as an 80% solution and add the features you wish .. in this case, things specific to the newsroom.  In the 80% solution, there’s no need to build the infrastructure or common elements, just the modules specific to your needs.   Another way to think of it is “assembling a solution using modules” rather than creating it from scratch.

    Sony Pictures has successfully done this, creating their own module to display show times, yet using the core of Drupal and a number of plug in modules that help them optimize their user experience, time to market and total cost of ownership.  The White House is a great example of doing this as well, even contributing back the modules they created.

    Open source requires a change in thinking about the innovation process.   There’s a lot of research going on about this, led by UC Berkeley.

    The transition to open source in software is not an overnight change, but it is one that is inevitable.   Linux and Android are already the number one offerings in their categories.   WordPress, Drupal and Joomla dominate the choices for CMS systems. I applaud Al Jazeera for their innovative approach.  There use of Drupal has not been without issues, but they have had great success.   An upcoming study from Forrester Research will reveal that open source CMS users are twice as happy as proprietary users.   There’s got to be something to that.

    Tom Erickson
    CEO Acquia

  • Julie Reece

    This site lists literally hundreds of popular news/media sites running on open source Drupal. If security were in issue, they wouldn’t have built their sites on Drupal.  Similarly, 24% of all .gov sites run on Drupal, including the Dept. of Defense, Dept. of Homeland Security, DoE, etc. Even NATO runs on open source Drupal.  Security is critical to these organizations, and Drupal meets all of their requirements – and then some. This link lists public sector sites running on Drupal,

  • JBingold

    1 dev in #drupal vs 5 jobs for the custom CMS that exactly the ratio 20% of specific s the 20% specific features eljazeera need would 5 #drupal they would have a much better customize solution

  • dickolsson

    It’s unfortunately not that simple. Resources is only one challenge,  as the article points out, there are many other challenges that needs to be overcome for a successful adoption.

    But you are right, in many cases the efforts required to run a Drupal site are smaller than on other systems. But many times the required resources are also the same!
    The real value proposition of open source is the freedom, the flexibility and how agile you can be in delivering business value *faster* than other systems. That’s what companies should focus on.