HOME
          
LATEST STORY
U.S. journalists, the clock is ticking: January 31 is the deadline to apply for a Nieman Fellowship
ABOUT                    SUBSCRIBE
Aug. 31, 2011, 2:30 p.m.

Mirror, mirror: The New York Times wants to serve you info as you’re brushing your teeth

Meet the R&D Lab’s latest: a proof of concept in the form of a “magic mirror.”

Information is everywhere — in the world, in your home, everywhere. In today’s pair of videos from my visit to The New York Times Co.’s R&D Lab, Brian House, The Times Co.’s Creative Technologist for R&D, demonstrates the Lab’s, er, reflection of that idea — in the form of a data-bearing mirror. The device (working name: “the magic mirror”) uses Microsoft’s Kinect motion-sensing technology to read physical cues from its user; it uses voice recognition technology to detect verbal cues. (In the videos, you’ll hear House talk to the mirror, Snow White-style.) The mirror also uses the the Times’ powerful APIs to serve up information on-demand.

The device, within its notional home, would replace the standard bathroom mirror. And like the R&D Lab’s screen-topped table, it’s all about bringing a new kind of intimacy to the news experience. You can use it, say, to browse Times headlines, or watch Times videos, while you’re brushing your teeth. You can use it to schedule events on your personal calendar, or to shop online, or to exchange messages — from the classic “buy milk” on up — with other members of your household. While the mirror is capable of serving (relatively) traditional forms of content — individual articles, videos, etc. — via its screen functionality, even more striking is its experimentation with information that has, directly, very little to do with the Times itself. In exploring the realms of health and commerce alongside more standard editorial content, the Times Co. is hinting at the products we might see when news organizations expand their scope beyond the news itself.

Essentially, the mirror fuses news — and, in this case, a highly branded, New York Times experience of the news — with all the other forms of data that we encounter in our daily lives. Again, the “information shadow” idea. By building a device that is both a screen and a mirror, the R&D Lab can experiment with the ways to combine the personal and the informational in ways that (it hopes!) aren’t intrusive, but rather helpful and, in that, welcome. This is The New York Times Company acting not just as a curator of information about the wider world, but also as a curator of the information that punctuates, and complicates, and in some sense defines its customers’ personal lives.

Here are the videos’ transcripts.

Health:

So one more thing with health. In an off-the-shelf product like Claritin, here, you know, even though it’s not a fancy digital device, it can still participate in information exchanges by virtue of an RFID present in the packaging. So we put it on our shelf here; it’ll bring up directions on how to take it — it’s a lot easier to read than on the box itself.

It can also, by virtue of it knowing what my schedule is — and maybe I have a trip coming up, and it knows that I’m using this product — that creates another information intersection that we can use to query our database, and bring up an article that might be interesting.

And it’s also a retail opportunity. So, say, based on my use of this product, that a local retailer wants to promote something to me.

“Mirror: show coupon.”
“Mirror: show coupon.”

I can call up a coupon here, and then save it to my phone, and then go to a physical location to redeem it. So, again, it’s a conversation that happens in front of the mirror, but then it can drive behavior elsewhere, out in the world.

A similar thing with prescription information. There’s a lot of information behind this, and I can call it up by putting it on the shelf. So it’s personalized to my particular prescription: It shows my doctor and how many days I have left with this prescription, and when my next appointment is, etc. And you can imagine knowing what you’ve taken and what you haven’t taken — or, if you have a family, knowing which medication is yours, or for elderly people to help them take their medications on time. So there’s a lot of possibilities in this domain, too.

Retail:

So we have another mirror under development, which will have a few more bells and whistles and focus on the retail experience — which is another domain in which an interface like this might make sense for it to play a part. We do a proof of concept here, quickly:

Mirror: show retail.

So this is fun because it’ll find my face — and from my perspective, the tie lines up. It’ll attempt to match the colors to put on the tie. So, again, it’s all about context. And you can see previous outfits that I may have been wearing, and from there make recommendations about what I might like to try on next, etc. We’re working on this, and so we’ll have some more to come.

POSTED     Aug. 31, 2011, 2:30 p.m.
PART OF A SERIES     The New York Times R&D Lab
SHARE THIS STORY
   
Show comments  
Show tags
 
Join the 15,000 who get the freshest future-of-journalism news in our daily email.
U.S. journalists, the clock is ticking: January 31 is the deadline to apply for a Nieman Fellowship
It’s a chance to spend a year at Harvard and change the shape of your career.
Newsonomics: How deep is the newspaper industry’s money hole?
Forget keeping up with the economy — what would it take for the newspaper business just to keep up with inflation? Even the “growth” areas are slowing down.
Don’t try too hard to please Twitter — and other lessons from The New York Times’ social media desk
The team that runs the Times’ Twitter accounts looked back on what they learned — what worked, what didn’t — from running @NYTimes in 2014.
What to read next
1510
tweets
Don’t try too hard to please Twitter — and other lessons from The New York Times’ social media desk
The team that runs the Times’ Twitter accounts looked back on what they learned — what worked, what didn’t — from running @NYTimes in 2014.
692Q&A: Amy O’Leary on eight years of navigating digital culture change at The New York Times
“In 2007, as digital people, we were expected to be 100 percent deferent to all traditional processes. We weren’t to bother reporters or encourage them to operate differently at all, because what they were doing was the very core of our journalism.”
544How do you get millennials to care about local news? The Charlotte Observer is testing out one idea
Its new website and newsletter Charlotte Five is an attempt to use lessons from viral publishers to find a spot in young people’s daily habits.
These stories are our most popular on Twitter over the past 30 days.
See all our most recent pieces ➚
Encyclo is our encyclopedia of the future of news, chronicling the key players in journalism’s evolution.
Here are a few of the entries you’ll find in Encyclo.   Get the full Encyclo ➚
The Daily Voice
Grist
Newsday
The Globe and Mail
American Public Media
New Haven Independent
Newsweek
The Huffington Post
DocumentCloud
InvestigateWest
The Bay Citizen
Seattle PostGlobe