MIT creates amazing UI from levitating orbs
May 18, 2012 | Source: Fast Company
In The Avengers, Tony Stark manipulates objects in thin air. MIT Media Lab researchers Jinha Lee and Rehmi Post have actually created a similar tactile user interface for manipulating real floating objects in 3D space, called the ZeroN.
It’s essentially a small field in which gravity doesn’t overcome an object. Through the efforts of finely tuned electromagnetism, a user can place a metal ball in midair as easily as they’d place something on a shelf.
The ball can be repositioned by hand or by computer, it can be animated on a path, and with the help of software, it can even serve as a virtual camera or light source in a 3-D scene (a sort of 3-D animation suite that you can touch).
Lee has hidden the real magic just above where there’s a 3-D actuator housing an electromagnet. It’s this arm that provides the perfectly tuned magnetic loop (requiring a circuit built by Rehmi Post from MIT’s Center for Bits and Atoms), to keep the ball stable. But to drag that ball around lateral space, the actuator actually just repositions itself, moving in tandem with object, and keeping an eye out on its position with 3-D infrared cameras (as you see in the Kinect).
“ZeroN can remember how it has been moved. Physical motions of people can be collected in this medium to preserve and play them back indefinitely. When the users move and release the ZeroN, it continues to float and starts to move along the same path. This allows a unique, tangible record of a user’s physical presence and motion which will continue to exist even after the death of the person,” Lee explains.
“With this functionality, ZeroN can be adopted in many applications: animation prototyping, physics simulation/education, and 3-D design studios, etc. Many of the control that users had to have with mouse and a screen can be tangible and more intuitive.”

Comments (13)
by Katherine MacLean (old science fiction writer and research fan
Wonderful new superstrong materials out of mostly carbon, and sub microscopic machines and electronics, making possible miniature machines and electronics, making space travel and settlement of the solar system must a matter of time. Solar power cells can spread homes to the tops of mountains and the bottom of the sea without much expense. That’s what is going to make a difference to our lives and save the planet from overcrowding by using the almost half of it now deserts to become friendly to humans and animals and forests. to be irrigated and moderated and comfortable for all kinds of life. And move the comfort of power anyplace at all for whatever you need it for anywhere on Earth and planets and into space onto planets and asteroids, I’ll save my excitement for the improvers and manufacturers of solar power fabrics, to wear. to make tents and roofs. Power available anywhere the sunshine reaches in the solar system. Just a little bit more polishing and we’ve got it! Let smart young manufacturers find all the uses of the tech we have already and stop the use of pollutants and Send non-polluting residences and greenhouse interiors to anywhere at all. Find wonder in floating a marble with a magnet ? How about floating a city in space without a magnet?
by Katherine MacLean (old science fiction writer and research fan
It sounded special, mentioning some manipulation of gravity, but its just good old magnetism, nothing really new. Cute tricks.
by Derek
what about having musicians/athletes play within that space? With 3D spatial recording and augmented gravity, things could be good.
by The Watcher
I think its impressive, maybe this first showing of it isn’t exactly the best, but the different ways it can be used can have benefits for artists or even astronauts like Lord Penguin posted. Instead of making just a 2D or 3D looking painting, you could craft and mold objects with a 3D printer, put that around magnetic balls and have a real 3D piece of art floating in the air.
by Lord Penguin
This technology could be used on a larger scale than a UI for many things. For example, a house in which one could leave stuff floating around while they’re doing something and get it more easily than setting it on a table. Or special rooms where astronauts could train in apparent high, low, or even no-gravity environments (water resistance makes current Earth-based training “rooms” unlike space).
by Mark
That would require every object to be embedded with a magnet and for powerful electromagnets and cameras to be set up all over the home. Also, regarding astronauts, they would have to be coated in a powerful magnet and I don’t believe the forces would cancel out correctly as the body moves and takes different shapes.
This is well suited for UI applications. I’m sure there are more but the two mentioned have better options available than this.
by Tzigane
Ever had a colonoscopy, add CATc and a camera and more work of course and … or reduce the size to nano particles delivering to specific cancer targets, etc. and … convergence of technologies will bring this as a component of other very smart tools.
by aheri
nice UI, if you’re into playing with balls, that is…
by egore
If they could levitate a Hot
dog on a stick, that would be impressive!
by Christian Gehman
You might want to re-read SLAN.
by Christian Gehman
@Victor K — Similarly, computer technology started out as an agglomeration of technologies that had all “been around for a long time just used in a “gimmicky” way.” Many good-hearted but short-sighted people, at first, questioned the need for such very high powered, extraordinarily adding machines. What’s wrong with your abacus?
by Victor Konshin
Is it just me, or is this not really that impressive? It’s just a ball being suspended by an electromagnet. Yeah, it can be moved around and yes, there are a couple of cameras keeping an eye on it but there isn’t really anything groundbreaking here. These are all technologies that have been around for a long time just used in a “gimmicky” way. Does not seem very useful…
by Mark
That’s basically what inventing is. You’re usually not developing entirely new technologies but rather putting together current technologies (including recent advances in the ability of these technologies) and using them in novel ways.
It’s not just a “ball being suspended by an electromagnet.” It’s that and the magnet moves to adjust for the movement of the ball. Those movements are recorded and can be played back. This combination has valuable applications for user interfaces. Increase the capture rate of the cameras, put the magnets in gloves, and put visual markers on the gloves for the cameras to pick up and you have the framework for the UI in Minority Report.