Facial sensors and software to help Hawking communicate faster
January 21, 2013

(Credit: Wikimedia Commons)
Intel is developing communication technology that can quickly process and respond to signals Stephen Hawking sends from the few muscles in his body that he can still control, Scientific American reports.
Intel chief technology officer Justin Rattner noted that Hawking can make a number of facial expressions that might be used to speed up the rate at which the physicist conveys his thoughts. Even providing Hawking with two inputs would give him the ability to communicate using Morse code, “which would be a great improvement,” said Rattner.
For the past decade Hawking has used a voluntary twitch of his cheek muscle to compose words and sentences one letter at a time that are expressed through a speech-generation device connected to his computer. Each tweak stops a cursor that continuously scans text on a screen facing the scientist, achieving a mere one word per minute.
Intel’s new system will use Hawking’s cheek twitch as well as mouth and eyebrow movements to provide signals to his computer. “We’ve built a new, character-driven interface … that includes a better word predictor,” Rattner said. The company is also exploring the use of facial-recognition software.
Intel’s overall plan for identifying personal context requires a combination of hardware sensors — camera, accelerometer, microphone, thermometer and others — with software that can check one’s personal calendar, social networks, and Internet browsing habits, to name a few. “We use this [information] to reason your current context and what’s important at any given time [and deliver] pervasive assistance,” Rattner said.
Comments (6)
by Harley
One would think that with Tobii Eye Tracking and Swype keyboard type of input he could be communicating much faster. Would be nice to see something on video to explain which aspects in particular are causing the barriers.
by deadalus
i was thinking the same thing, those cheapo EEG headsets are already proven to be able to allow a user to express multiple repeatable inputs with practice, it would sure save a lot of upgrade time in the future, Steven hawking has long been one of the most inspirational figures in my life so either way i hope we get to hear many more theories from him for years to come, i have nothing but respect for people like him who faced with such a poor hand yet keep moving forward with their passions.
by Bri
I would have thought he would have one of those EEG brain interfaces.
by clains
I think I heard something about him being conservative? The thought of going to another medium is probably super scary. However, from an outside standpoint I agree – it seems clear that he can do better.
Case in point: http://www.youtube.com/watch?v=76lIQtE8oDY#t=5m
by Jeff Aronson
I was wondering if it might be possible to get contact information for the people at Intel who are working on this project. I am working on cutting edge technologies that may be of great benefit to their project.
Thanks
by Editor
You could start with Justin Rattner’s office