Twitter  "Algorithms have consequences." Zeynep Tufekci on Ferguson and net neutrality: nie.mn/VpE1Ef  
Nieman Journalism Lab
Pushing to the future of journalism — A project of the Nieman Foundation at Harvard

ProPublica’s newest news app uses education data to get more social

Yesterday, the U.S. Department of Education’s Office of Civil Rights released a data set — the most comprehensive to date — documenting student access to advanced classes and special programs in public high schools. Shorthanded as the Civil Rights survey, the information tracks the availability of offerings, like Advanced Placement courses, gifted-and-talented programs, and higher-level math and science classes, that studies suggest are important factors for educational attainment — and for success later in life.

ProPublica reporters used the Ed data to produce a story package, “The Opportunity Gap,” that analyzes the OCR info and other federal education data; their analysis found among other things that, overall and unsurprisingly, high-poverty schools are less likely than their wealthier counterparts to have students enrolled in those beneficial programs. The achievement gap, the data suggest, isn’t just about students’ educational attainment; it’s also about the educational opportunities provided to those students in the first place. And it’s individual states that are making the policy decisions that affect the quality of those opportunities. ProPublica’s analysis, says senior editor Eric Umansky, is aimed at answering one key question: “Are states giving their kids a fair shake?”

The fact that the OCR data set is relatively comprehensive — reporting on districts with more than 3,000 students, it covers 85,000 schools, and around 75 percent of all public high schoolers in the U.S. — means that the OCR data set is also enormous. And while ProPublica’s text-based takes on the info have done precisely the thing you’d want them to do — find surprises, find trends, make it meaningful, make it human — the outfit’s reporters wanted to go beyond the database-to-narrative formula with the OCR trove. Their solution: a news app that encourages, even more than your typical app, public participation. And that looks to Facebook for social integration.

The app focuses on measuring equal access on a broad scale: It tracks not only the educational opportunities provided by each school, but also breakdowns of students’ race, disability status, gender, and English proficiency. It also highlights the percentage of teachers with two years’ experience or less — who, as a group, tend to effect smaller achievement gains than their more experienced counterparts — and the percentage of students who receive free or reduced-price school lunch, an indicator of poverty. (More on the developers’ methodology here.)

ProPublica leads the field in developing news apps; each one demands a unique strategy for determining how users will actually navigate — and benefit from — the app’s interface. With this one, “we were focusing a lot more on what behaviors we wanted to encourage,” says Scott Klein, ProPublica’s editor of news applications. ProPublica is constantly thinking about how to organize reporters, both within and outside of its newsroom, around its stories, notes Amanda Michel, ProPublica’s director of distributed reporting. “Here, we wanted to take it one step further.”

With that in mind, the app invites both macro and micro analysis, with an implicit focus on personal relevance: You can parse the data by state, or you can drill down to individual schools and districts — the high school you went to, or the one that’s in your neighborhood. And then, even more intriguingly, you can compare schools according to geographical proximity and/or the relative wealth and poverty of their student bodies. (Cambridge Rindge and Latin School, just down the street from the Lab, has 1,585 students, 38 percent of whom receive a free or reduced-price lunch; Medfield Senior High, a few miles southwest of Cambridge, has 920 students and a 1-percent free/reduced lunch rate. Twenty-four percent of Rindge and Latin’s students are enrolled in advanced math courses; for Medfield High, the rate is 42 percent. Compare that to Health and Human Services High School in Lawrence, which has 89 percent of its students on free or reduced-price lunch — and an advanced-math-enrollee rate of 4 percent.)

“It really is an auto-story generator,” Umansky says.

And it produces the kind of stories and stats people want to share, probably with some kind of “!!!” notation. And sharing — the Facebook aspect of the app — is a big part of the behavior ProPublica’s news apps team wanted to encourage for its users. They considered social integration from a structural perspective, notes Al Shaw, the developer who authored the app, and worked with Vadim Lavrusik, Facebook’s Journalist Program Manager, to optimize the app-to-Facebook interface. One small-but-key feature: With that integration, users who are signed into Facebook can generate an individual URL for each cluster of data they dig up — the Cambridge-versus-Medfield-versus-Lawrence comparison, say — to make sharing and referencing the data almost seamless. The resulting page has a “share on Facebook” button along with a note: “Use this hashtag to share your insights on Twitter: #myschoolyourschool.”

The ed-data app isn’t social for its own sake; instead, it serves the broad and sometimes nebulous goal of having impact — on both a personal and a policy level. “We invest so much time into acquiring data and cleaning data and making sense of data,” Michel notes; ultimately, though, data doesn’t mean much unless people can understand how it immediately affects them, their communities, their kids. Its newest app, Michel says, is part of ProPublica’s broader strategy: to make data, overall, more social. (They’d like to do a similar integration with Twitter, too, she says.) The point is to find ways to marry social and story, to turn online interactions into their own kind of data sets — so, she says, “people can layer their stories on top of them.”

                                   
What to read next
ann-arbor-chronicle-morganaskins2012
Joseph Lichterman    Aug. 12, 2014
The site, known for its focus on local government, was financially stable. But as with many indie local news sites, it only worked with a heavy workload for its founders.