Twitter  Quartz found an unlikely inspiration for its relaunched homepage: The email newsletter.  
Nieman Journalism Lab
Pushing to the future of journalism — A project of the Nieman Foundation at Harvard

Digging deeper into The New York Times’ fact-checking faux pas

“Truth vigilante” or no, the hubbub over fact-checking in news articles gets at some deeper issues about how journalists view their own work.

Once in a while the cultural fault lines in American journalism come into unexpectedly sharp relief. Jon Stewart’s now-legendary star turn on “Crossfire” was one of those moments; the uproar over NPR’s refusal (along with most major news outlets) to call waterboarding torture was another. The New York Times may have added another clash to this canon with public editor Arthur Brisbane’s blog post on fact-checking last week.

For anyone who missed it (or the ensuing analysis, rounded up here) the exchange can be summed up in two lines of dialogue:

Times to Internet: Should we fact-check the things politicians say?

Internet to Times: Are you freakin’ kidding?

That was an actual response, and a popular refrain: More than a dozen comments included some variant of, “This is a joke, right?” Several readers compared the column to an Onion piece. By far the most common reaction, which shows up in scores of comments, was to express dismay at the question or to say it captures the abysmal state of journalism today. A typical example, from “Fed Up” in Brooklyn: “The fact that this is even a question shows us how far mainstream journalism has fallen.”

The stunning unanimity of reader responses was undoubtedly the big story, as the news intelligentsia pointed out right away. It underscores the yawning gulf that separates professional reporters’ and everyday readers’ basic understandings of what journalism is supposed to do. Of the 265 comments logged in the three hours before the Times turned off commenting, exactly two (discounting obvious sarcasm) disagreed with the proposition that reporters should challenge suspect claims made by politicians. (More on the dissenters, below.) Brisbane’s follow-up, suggesting many readers had missed the nuance by assuming the question was just whether the paper should “check facts and print the truth,” seems off base. A few may have made that mistake, but most clearly have in mind what is sometimes called “political fact-checking” — calling out distortions in political speech.

If anything, reading through the comments what’s striking is the robust and stable critical vocabulary readers share for talking about the failings of conventional journalism. More than a dozen take issue with the definition of journalistic objectivity implied by Brisbane’s wondering whether reporting that calls out untruths can also be “objective and fair.” As a reader from Chicago wrote,

I see this formulation as a problem. Objective sometimes isn’t fair. Some of the people reported on are objectively less truthful, less forthcoming, and less believable than others.

False “balance” in the news is a common trope in the comments, which readers refer to both directly (at least eight times) and via now-standard illustrations of “he said/she said” reporting, like the climate-change debate (brought up by five readers) or the parodic headline “Shape of the Earth? Views differ” (mentioned by another nine). Journalism-as-stenography also comes up frequently — at least 20 of the responses make the comparison specifically, while 16 declare that the Times may as well run press releases if it isn’t going to challenge political claims.

The disconnect between reporters and readers, and the paradox at the center of “objective” journalism, comes through most clearly in Brisbane’s rendering of the division of labor between the news and opinion pages. Pointing to a column in which Paul Krugman debunked Mitt Romney’s claim that the President travels the globe “apologizing for America,” Brisbane explains that,

As an Op-Ed columnist, Mr Krugman clearly has the freedom to call out what he thinks is a lie. My question for readers is: should news reporters do the same?

To anyone not steeped in the codes and practices of professional journalism, this sounds pretty odd: Testing facts is the province of opinion writers? What happens in the rest of the paper? As JohnInArizona commented,

Mr. Brisbane’s view of the job of op-ed columnist vs that of reporters seems skewed.

It is the job of columnist to present opinion and viewpoint, and to persuade. It is the job of reporters to present facts, as best as they can determine them.

As others have pointed out, uncritically reprinting politicians’ statements is not what a good reporter, or a good newspaper, should be doing. There is no choosing between competing facts — a statement is factual, or is not…

Journalism has a ready response for this line of critique: The truth is not always black and white, and reporters run the risk of “imposing their judgement on what is false and what is true” (Brisbane’s phrase) by weighing in on factual questions more complicated than the shape of the earth. Politicians are expert in misleading without lying, and people may genuinely disagree about what the facts are — based on different notions of what constitutes a presidential apology, for instance.

Even in these cases though, a reporter can add context to help readers assess a claim. Brisbane himself suggests that,

Perhaps the next time Mr. Romney says the President has a habit of apologizing for his country, the reporter should insert a paragraph saying, more or less: “The president has never used the word ‘apologize’ in a speech about U.S. policy or history. Any assertion that he has apologized for U.S. actions rests on a misleading interpretation of the president’s words.”

A few readers responded that the second sentence is superfluous. Several others suggested doing additional reporting around the question, along these lines: “A real reporter might try to find those speeches. A real reporter might request that the Romney campaign provide examples of times where Obama has apologized for America…”

That sort of reporting is exactly what fact-checkers at PolitiFact and the Washington Post did to refute the claim, reconstructing the “apology tour” meme as developed in various Republican documents (Romney’s 2010 book “No Apology,” a Karl Rove op-ed in The Wall Street Journal, a Heritage Foundation report, etc.) and digging into the actual text of Obama’s speeches as well as comparable ones by previous presidents. PolitiFact went so far as to interview several experts on diplomacy and political apologies. Reading the public editor’s letter, though, you’d have no idea that the key example he uses to illustrate his column already has been checked and found wanting.

More to the point, you’d have no clue about what AJR has called the “fact-checking explosion” in American journalism — a movement that is at least a decade old (the short-lived Spinsanity launched in 2001, followed by in 2003) and now spans dedicated fact-checking groups as well as newspapers, TV networks, radio outlets, and even journalism schools. (Full disclosure: I’m writing a dissertation, and eventually a book, about this movement.) Fact-checking has been very much in the ether lately, with news gurus weighing in on the limits of this kind of journalism, especially during the controversy over PolitiFact’s latest “Lie of the Year” selection.

The fact-checking movement is part of a larger ongoing conversation about journalistic objectivity that began with the news media’s failures in the lead-up to the Iraq war. (See Brent Cunningham’s “Rethinking Objectivity,” Jay Rosen’s “The View from Nowhere,” Michael Massing’s “Now they Tell Us.”) Most fact-checking groups don’t spend a lot of time tweaking their peers in the press, even though the claims they check usually go unchallenged in news accounts. But they don’t have to — their entire project is a critique of mainstream journalism, a self-conscious experiment in “rethinking objectivity.”

That sense of mission — of fact-checking as a kind of reform movement — is unmistakable when fact-checkers get together, as at a New America Foundation conference on the subject last December, and one at CUNY the month before. (Here’s a write-up of the two conferences.) In a report written for the New America meeting, the Post’s original “Fact-Checker” columnist, Michael Dobbs, placed fact-checking in a long tradition of “truth-seeking” journalism that rejects the false balance practiced by political reporters today. (Three reports from that conference will be published over the next month.)

From the precincts of this emerging reformist consensus, Brisbane’s column seemed surprisingly out of touch. Still, the public editor raises questions that haven’t been answered very well in the conversation about fact-checking. It’s easy to declare, as Brook Gladstone did in a 2008 interview with Bill Moyers, that reporters should “Fact check incessantly. Whenever a false assertion is asserted, it has to be corrected in the same paragraph, not in a box of analysis on the side.” (I agree.) But why, exactly, don’t they do that today? Why has fact-checking evolved into a specialized form of journalism relegated to a sidebar or a separate site? Are there any good reasons for it to stay that way?

Answering those questions has to begin with a better understanding of why so many traditional “objective” journalists are wary of the fact-checking upstarts. Michael Schudson, a historian of journalism (and my graduate-school advisor), has written that the “objectivity norm guides journalists to separate facts from values, and report only the facts.” In practice, though, the aversion to values becomes an aversion to evaluation. Hence the traditional rule against “drawing conclusions” (discussed here) in news reports. Brisbane doesn’t flesh out this rationale, but one of his readers captured it perfectly, and is worth quoting at length:

I cannot claim to be a regular reader of the New York Times, and I cannot claim to have ever been to journalism school. Finally, I also cannot claim to know what “the truth” is. I do not understand why so many readers are presenting such unequivocal opinions as commentary here.

If a candidate for US president says something — anything — I would like to know what he or she said. That’s reporting, and that’s “the truth” in reporting: a presentation of the facts, as objectively as possible.

Whether a candidate was coy about something, exaggerating something else, using misleading language, leaving something out of his or her public statements… all of these things are analysis. …

Finally, it is the responsibility of the reader, of the informed citizen, to take all of this in and think for himself or herself, to decide where he or she stands on issues, on phenomena in society. Neither the New York Times nor any other newspaper ought to have the privilege of taking that final step for anyone.

This reads like a more thoughtful version of David Gregory’s infamous response when asked why he doesn’t fact-check his on-air guests: “People can fact-check ‘Meet the Press’ every week on their own terms.” It rests on the concern — elaborated in this Politico post and in a Journal editorial — that fact-checking tends to shade into opinion, glossing over genuine differences in political ideology. The WSJ decried a “journalistic trend that seeks to recast all political debates as matters of lies, misinformation and ‘facts,’ rather than differences of world view or principles.”

The only problem with the “don’t draw conclusions” standard is that reporters draw conclusions all of the time, and now more than ever. The decades-long trend toward more analytical reporting, probably self-evident to any news junkie, has been thoroughly documented by communications scholars (who, following Kevin Barnhurst, sometimes call this “the new long journalism” or the “decline of event-centered reporting.”) Reporters are of course especially comfortable drawing conclusions about political strategy, liberally dispensing their analysis of what a candidate or officeholder hopes to gain from particular “messaging” and whether the strategy is like to work.

So objective journalism applies the ban on drawing conclusion very selectively. What seems to make reporters uncomfortable is not analysis per se but criticism, especially criticism that can be seen as taking sides on a controversial question — which they will avoid even at the risk of profound inconsistency. Here’s Bill Keller’s much-ridiculed rationale (quoted in a Media Decoder post) for refusing to describe waterboarding as torture in the pages of the Times, though the paper had often referred to it that way before the U.S. took up the practice:

When using a word amounts to taking sides in a political dispute, our general practice is to supply the readers with the information to decide for themselves.

The result revealed the awkward gap between common sense and journalistic sense. Common sense says, if it was torture then, it’s torture now. Journalistic sense says, this is really controversial! It’s not our job to accuse a sitting president of authorizing an illegal global regime of torture! (Conversely, it was profoundly uncontroversial to apply the label to waterboarding in a country such as China. Journalists could do so unthinkingly.)

This political risk aversion is nothing new. One of the most cited pieces of research on journalism is Gaye Tuchman’s ethnographic look at the “strategic ritual” of objectivity as practiced in a newspaper newsroom in the 1960s. Tuchman stressed the essentially defensive nature of the claim to be objective, and of the reporting routines it produced. Her “newsmen” shied away from criticism of public figures or public policies — or found someone else to voice them — because they were deeply, institutionally afraid of drawing attacks or even lawsuits from the people they reported on. (They used the “news analysis” label to set off reports that were less “objective,” though Tuchman found reporters and editors could not supply a coherent rationale for distinguishing between the two kinds of stories.)

The new, professional fact-checkers are specialized in ways that mitigate (but don’t eliminate) these concerns. They dedicate pages to analyzing even a simple claim, showing all of their work, so that someone who dislikes the result might still agree it was reached fairly. Full-time fact-checkers don’t have to worry about losing “access” to a public figure, because they don’t rely on inside information. (For the same reason, fact-checkers don’t use anonymous sources.) And they obviously — to occasional criticism — make an effort to check politicians from both sides of the aisle.

And still, fact-checkers constantly come in for vehement attacks from political figures and from the reading public. It’d be hard to prove that this is more pronounced than what traditional news outlets weather; my anecdotal sense is that it might be. (They manage this feedback in interesting ways; for instance, neither nor PolitiFact allow comments on the same page as their fact-checks, though they do often run selections from reader mail.) Without validating the view that “if everybody’s mad at us, we must be doing something right” — a journalistic reflex one also hears from fact-checkers — it has to be acknowledged that this is a deeply polarizing activity. Managing that polarization is part of what fact-checkers have to do in the effort to stay relevant and make a difference in public discourse.

The hope for building fact-checks into everyday news reports is that it would push political reporters to be more thoughtful and reflexive about their own work — to leave out quotable-but-dubious claims, to resist political conflict as the default frame, and in general to avoid the pat formulations that are so ably managed by political actors. But inevitably, all of us will be disappointed, even pissed off, by some of these routine fact-checks — and perhaps all the more so when they’re woven into the story itself.

To take Brisbane’s question seriously and think about how this might be put into practice, we have to consider how reporters will manage the new set of pressures this work will expose them to. And we have to confront the paradox that trying to create a platform for a more fact-based and reasonable public discourse may also, at the same time, promote further fragmentation and politicization of that discourse.

Lucas Graves is a PhD candidate in communications at Columbia University and a research fellow at the Media Policy Initiative of the New America Foundation.

What to read next
Justin Ellis    Aug. 25, 2014
Developers, designers, and writers from across the Vox Media family are getting involved in building new storytelling tools for the tech site and plotting its next phase of growth.
  • Bjpeters

    Very helpful. The first calm-headed reflection on the tricky politics of fact-checking to come in the wake of the most recent NYT comments screech fest. 

  • Dana Blankenhorn

    The idea that journalists won’t call lies lies renders them worthless. I was taught at Medill that was a big part of my job. Now that I’m using the blogging format it’s still part of my job. The NYTimes may not consider me a journalist as a result. Fine. I won’t sully the good name of blogging by associating with them, then.

  • Drue Hontz

    Fantastic article….  
    I think some of the questions you asked might have a simpler answer than most people would think.Regarding Bill Moyers interview on fact checking, ” But why, exactly, don’t they do that today? Why has fact-checking
    evolved into a specialized form of journalism relegated to a sidebar or a
    separate site? Are there any good reasons for it to stay that way?”Biased people = biased reporting, and as long as this is deemed acceptable in the media space, it will continue.  

  • Jonathan Stray

    “They dedicate pages to analyzing even a simple claim, showing all of their work, so that someone who dislikes the result might still agree it was reached fairly.”

    Exactly. Journalism has long had sloppier standards of “truth” than scholars and scientists. I think this is partly due to the habit of trying to draw each story to a close, which Paul Ford has dubbed The Epiphantor. Matt Thompson has also pointed out that news stories almost never tell us what isn’t known yet. And news organizations are somewhere between inconsistent and indifferent about linking to primary sources or detailed arguments.

    In other words, I suspect that part of the reason fact checking isn’t a part of the routine process of news production is that, to do this either:

    - stories would have to be deeper (though not necessarily longer),  more tightly argued, and far better sourced and cited


    - journalists would have to get comfortable with saying, “we think this is an interesting claim, and we are skeptical, but we have not yet done the research to check it out”

    More “factual” journalism is going to require both more sophistication and more transparency.

  • Evil Demon 501

    For most of my more than 60 years of life I’ve had great respect for the New York Times.  In recent years this respect has been slowly fading away.  Now it 99+% gone.  NYT is another formerly great newpaper that has seemingly decided to commit suicide.

  • Gene

    Most of the focus here seems to be on fact checking the statements of politicians. However, I expect that most US citizens already have a default skeptical stance on their statements and they are regularly rebutted in public by their political opponents. 
    I think increased attention to fact checking journalistic commentary and ‘hard news’, as well as scientific claims, both of which have tremendous impact on public perceptions and beliefs, would be of more value.

  • Matt Schafer

    Fact checking is a difficult proposition for anyone, because truth has gradations and not everyone agrees on where truth fades into falsity. Just ask Bill Adair at Politifact, a project of the St. Petersberg Times devoted to fact checking, who suffered scathing outrage when Politifact chose as the “Lie of the Year” Democratic claims that Rep. Paul Ryan’s budget would “end Medicare.” Paul Krugman, writing in The Times, wrote in response, “This is really awful. Politifact, which is supposed to police false claims in politics, has announced its Lie of the Year — and it’s a statement that happens to be true.”
    Adair’s situation is informative. Some felt that the “lie” Politifact was trying to debunk was not verifiable. That is, it did not lend itself to a definitive judgment by a journalist as to whether it was actually true or false. In such situations, journalists inevitably risk losing face. Perhaps backlash of the type that Adair faced is factored into journalists’ decisions to not fact check. (Indeed, even Greenwald, who lambasted Brisbane for, in his mind, asking whether the Times should be fact checking at all called Politifact a “scam of neutral expertise.”)
    While it is cliché, journalism is in crisis, in part, because news copy is cheap (if not free) and widely available. The Times and other newspapers then must offer readers something that other news outlets or online opinion manufacturers cannot. In this case, that something is fact checking. Fact checking is in many instances time and resource intensive. Anyone can turn out a news article quoting the he said/she said between Romney and Gingrich, for example, but not everyone can devote the resources to parsing apart the candidates’ words. Critically, unapologetically, and obviously labeling political Pinocchio’s liars should be traditional newspapers’ new niche.
    Read more:

  • Jason

    Excellent, thorough, thoughtful article.

  • Anonymous

    Superb piece.  

    Another potent ingredient of this mess is that political propaganda becomes more sophisticated by the day and its flow has become a deluge.  More than two decades ago, when spin was only a hint of what reporters have to deal with now, my career veered away from being a national correspondent and national editor for big newspapers.  So I marvel at the change from the perspective of someone who’s been there — and am challenged to imagine how, on a day-to-day breaking-news basis reporters can even begin to neutralize today’s toxic gusher.

    I see the advent of fact-checking departments as an inevitable response to daily reporters’ being legitimately overwhelmed.

  • David Vass

    I wonder whether this problem could be considered in terms of the problems of the creation of narrative. Reporters overtly or covertly hope to cover a event, which means to reproduce the event in itself without the inclusion of references that would disrupt the narrative of the event. To them the objective is to create a narrative that is the least removed from the event as possible. The facts in this case are the facts of the event (be that an interview, speech or other).
    On the other hand, fact checking takes the event and removes the reader/viewer further from, by not just presenting, but by examining what took place. In this case the truth is not simply the truth of what has taken place or what has been said. The truth is only produced later by the journalist.
    In the first case the reporter hopes to simply present facts of history confined to the event. The truth is not determined by her/him, it is the reader that has to construct their own narrative and thus produce the truth.
    Fact checkers seem to favor the idea that truth is produced with facts taken from the event and other facts of history. Here the truth has been created before it gets to the consumer.
    To my mind both sides lay legitimate claims to truth and both can and should criticize the other for too much misplaced faith in their own objectivity. However, to my mind, one of the problems that journalists may have difficulty dealing with then is juggling or deciding between the two narratives.

  • Prcoach

    Without fact-checking, editorial oversight and absolute trust, what value do journalists bring that I can’t find in thousands of thoughtful analyses by citizen journalists and bloggers? To put it in businesss terms, why the hell would I subscribe/pay?

  • Anonymous

    I like the fact that the head line on this piece is itself slanted heavily: ‘faux pas’? when in fact the excellent article actually unpacks that kind of easy categorisation…

  • Susan

    This is a very thoughtful analysis. Nevertheless, it misses a critical dynamic of contemporary journalism, which is the subsumption of erstwhile independent news outlets into “integrated” corporate empires that do not distinguish journalism from other revenue streams and place little or no value on the public role of the press. “He said, she said” will remain the default frame as long people are buying it. Eyeballs, click-thrus and revenue remain the biggest obstacles to the acceptance of any other frame.

  • Swamijim

    Interesting piece, but it is seriously flawed in the headline’s and lede’s assertion that it is “the Times” which bears responsibility for the faux pas. It was Art Brisbane who, as an independent, contract commentator, is responsible for a faux pas (if that’s what it was.)

  • Anonymous

    Thanks for a thought-provoking piece. I have two points to add — one specific and one broad: 

    1. Don’t be too quick to assume that waterboarding equals torture. No sane person would argue that it isn’t a harsh form of interrogation, but as former federal prosecutor Andrew McCarthy notes in his 2007 National Review Online column, “Waterboarding and Torture,” there’s a little-known legal definition for the word “torture.” As McCarthy wrote: “(T)he designation torture is reserved for practices causing ‘intense, lasting and heinous agony’ (quoting a 2002 D.C. Circuit Court of Appeals case).” 

    We could spend the rest of the day debating whether waterboarding meets that particular legal definition, but the bottom line is that a journalist should not cavalierly equate “torture” with “anything that I would personally consider uncomfortable.” 

    2. My biggest criticism of today’s mainstream journalists is their failure to recognize that objectivity requires more than just checking, say, whether Obama ever used the word “apology” in his overseas speeches. The dinosaur in the living room is that their decision to fact-check Mitt Romney is a subjective action in itself, as was their decision to send dozens of reporters to Alaska to probe the background of Sarah Palin. 

    I’m not arguing that Romney’s statements shouldn’t be fact-checked or that Palin’s background shouldn’t be probed. I’m pointing out that if the media apply this level of scrutiny only to Republican candidates (Does anyone remember dozens of reporters being sent to Chicago to probe candidate Obama’s background?) or fail to revisit the false promises of the current administration (Didn’t the president once say he would cut the deficit in half by the end of his four-year term?), then readers still aren’t getting the whole truth. For that matter, objectivity also depends on a news organization’s choice of what to cover and where (and how) to play it.  

    In other words, fact-checking is the easy part. The media’s reputation, such as it is, also depends on their ability (and willingness) to cover both sides of the spectrum with equal enthusiasm, regardless of their personal views. As the classic question goes: “Who watches the watchers?”  

  • Drue Hontz

    One of the more intelligent and astute comments I’ve seen a while, thanks for sharing.  The problem today isn’t as much fact checking as it is bias…. but since that’s my opinion I feel the need to back it up by showing data from a neutral data point so….

    “The Pew Research Center for the People & the Press has been tracking views of press performance since 1985, and the overall ratings remain quite negative. (2011) Fully 66% say news stories often are inaccurate, 77% think that news organizations tend to favor one side, and 80% say news organizations are often influenced by powerful people and organizations.”

    Full study:

  • UponFurtherReview

    Thanks. I appreciate the comments and the informative link. And I continue to be amazed that as readership and viewership spiral downward, traditional media institutions seem oblivious — or worse yet, arrogantly dismissive — of studies such as the one you present. 

    Is it so difficult to imagine that the average reader might pick up a copy of The New York Times or any other leading daily newspaper and say to himself, “That’s it; I’m canceling my subscription. I’m tired of seeing this level of consistent bias, not only in what the editors deem fit to print, but also what they deem unfit to print.” 

    By all means, MSM, tell me about Newt Gingrich’s relationship with Fannie and Freddie — but tell me, with equal fervor, about Barack Obama’s relationship with the owners of Solyndra, too.