Nieman Foundation at Harvard
HOME
          
LATEST STORY
How NPR considers what new platforms — from smartwatches to fridges — will get its programming
ABOUT                    SUBSCRIBE
March 5, 2014, 1:55 p.m.
LINK: kpq.github.io  ➚   |   Posted by: Joseph Lichterman   |   March 5, 2014

NFL teams spend the offseason reflecting on the past season and preparing for the next one. So like any good playcaller, the team at The New York Times’ 4th Down Bot is spending the months between the Super Bowl and the start of the 2014 preseason examining what it’s learned and how it can improve for the coming season.

The 4th Down Bot performs realtime analysis of every fourth down play in the NFL and determines whether a team should go for the first down, kick a field goal, or punt the ball away. The bot was a collaboration between the Times and Brian Burke of Advanced NFL Stats, who originally built the code.

On his personal GitHub today, Kevin Quealy, a graphics editor at the Times, writes about how the project was developed and outlined some of the bot’s successes (more than 10,000 Twitter followers!) and areas where it could be improved (a slow response time). The bot launched in time for Week 13 of the NFL season (in the midst of my Lions’ annual late season collapse, when the bot was a welcome tool to further question now-fired coach Jim Schwartz’s competence). Quealy said the bot probably should’ve launched sooner — a non-football kind of MVP — and he outlines a few other issues he might try to address in training camp:

It could feel more “live”. The lag between the end of the play and the analysis takes about a minute, but sometimes the delay on the play-by-play data lagged a bit, which meant you were getting bot analysis well after the other team started its drive. This isn’t ideal, but there just wasn’t much we could do about it.

Because it was programmed to analyze decisions that already happened, some aspects of N.F.L. play aren’t captured well. For example, when a team intentionally takes a penalty on 4th and 1 near midfield, the bot applauds the punt on 4th and 6 without properly scolding the 4th and 1. This particularly annoyed Aaron Schatz of Football Outsiders, who later got over it.

As many statisticians noted, it could display uncertainty better than it does. From my perspective, that’s the most legitimate criticism, and we hope to improve on it next year.

In his post, Quealy wrote that they’re “hoping to introduce a cousin or two this summer, too.” In a followup email, Quealy told me he’s looking to apply some of the successful aspects of the 4th Down Bot to other fields — possibly baseball or politics.

“But it’s not like I have a super secret project on my desktop that is already [4th Down Bot’s] next of kin,” he wrote. “Plus, we’re hoping to add features and build on our audience with 4th Down Bot, which is not an insignificant amount of work.”

Show tags Show comments / Leave a comment
 
Join the 35,000 who get the freshest future-of-journalism news in our daily email.
How NPR considers what new platforms — from smartwatches to fridges — will get its programming
“Generally, we try to get to ‘yes’ faster than we try to get to ‘no.‘”
“Who’s your 4chan correspondent?” (and other questions Storyful thinks newsrooms should be asking after the French election)
“The example of France shows it is possible to curtail [misinformation] campaigns. But to do so, newsrooms need to move the discussion out of the realm of the theoretical and into the practical.”
This is the story behind that double push alert The New York Times sent about Comey’s Trump memo
So why’d the Times make your phone buzz twice Tuesday afternoon? The inspiration was threaded tweets.