Microsoft’s plan to bring about the era of gesture control
October 22, 2012

GestSure uses Kinect for Windows to allow surgeons to look through medical images without having to touch unsterile equipment (credit: Microsoft)
With its Kinect for Windows program, Microsoft wants to make it common to wave your arms at or speak to a computer, Technology Review reports.
“We’re trying to encourage [software] developers to create a whole new class of app controlled by gesture and voice,” says Peter Zatloukal, head of engineering for the Kinect for Windows program.
Zatloukal says the result will be on a par with other big shifts in how we control computers. “We initially used keyboards, then the mouse and GUIs were a big innovation, now touch is a big part of people’s lives,” he says. “The progression will now be to voice and gesture.”
Health care, manufacturing, and education are all areas where Zatloukal expects to see Kinect for Windows succeed. Kinect for Windows equipment went on sale in February for $249 and is now available in 32 countries.
Jentronix is using it to help people with physical rehabilitation after a stroke. Freak’n Genius, offers gesture-based animation software.
Mark Bolas, an associate professor and director of the Mixed Reality Lab at the University of Southern California, and his group are experimenting with using Kinect to track very subtle behaviors — monitoring the rise and fall of a person’s chest to measure breathing rate, for example. Displaying an indication of someone’s breathing rate during a video call allows others to understand a person better, he says, and can show when to start talking without interrupting.
Comments (1)
by Ian
It’s not a progression from keyboard to mouse, that isn’t how it works.
A mouse has massively greater motor demands. Many people still rely on keyboards, and find gesture control an even greater barrier again than a mouse. Exclusive gesture control can be a huge source of exclusion for people with disabilities.
While innovation like this is fantastic, what Microsoft have been guilty of when they say ‘encourage developers’ is actually meaning ‘encourage developers to suport Kinect and no other form of input’ (see the number of MGS-published Kinect exclusive games), in order to drive sales of the hardware. Unfortunately that has a very simple effect – it creates disability and unnecessary exclusion.