Ubiquitous, gesture-controlled interfaces are one step
closer to reality, thanks to a new system developed at Carnegie Mellon
University. WorldKit lets you create interactive apps on any surface just by
waving your hand. The project was announced by the university on Thursday.
Scientists previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen.
Scientists previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen.
What is WorldKit?
Instead of being tethered to your hardware, WorldKit is designed to make access to computing instant and mobile by making the world your touchscreen. Right now, the system involves a ceiling-mounted camera and projector that record hand movements and then project onto the surface of your choice. Some potential uses include TV remote controls, which can be accessed by rubbing the arm of a sofa, or calendars that can be swiped onto doors.
Instead of being tethered to your hardware, WorldKit is designed to make access to computing instant and mobile by making the world your touchscreen. Right now, the system involves a ceiling-mounted camera and projector that record hand movements and then project onto the surface of your choice. Some potential uses include TV remote controls, which can be accessed by rubbing the arm of a sofa, or calendars that can be swiped onto doors.
Researchers
at the university's Human-Computer Interaction Institute (HCII) used a
ceiling-mounted camera and projector to record room geometries, sense hand
gestures and project images on desired surfaces.
How does
it work?
Robert Xiao, an HCII doctoral student, said WorldKit does not require such an elaborate installation. "Depth sensors are getting better and projectors just keep getting smaller," he said.
"We envision an interactive 'light bulb' — a miniaturized device that could be screwed into an ordinary light fixture and pointed or moved to wherever an interface is needed," he said. The system does not require prior calibration, automatically adjusting its sensing and image projection to the orientation of the chosen surface.
Robert Xiao, an HCII doctoral student, said WorldKit does not require such an elaborate installation. "Depth sensors are getting better and projectors just keep getting smaller," he said.
"We envision an interactive 'light bulb' — a miniaturized device that could be screwed into an ordinary light fixture and pointed or moved to wherever an interface is needed," he said. The system does not require prior calibration, automatically adjusting its sensing and image projection to the orientation of the chosen surface.
The
system currently allows for things like buttons, multitouch drawing (akin to a
whiteboard), and counting the number of object within an interaction “bubble.”
The existing prototype still has limited resolution and input dimensions, but
hardware advances and future research could allow voice commands or even
interaction in free space rather than on surfaces.
Users can summon switches, message boards, indicator lights and a variety of other interface designs from a menu. Ultimately, the WorldKit team anticipates that users will be able to custom design interfaces with gestures.
Users can summon switches, message boards, indicator lights and a variety of other interface designs from a menu. Ultimately, the WorldKit team anticipates that users will be able to custom design interfaces with gestures.
Future Work:
The findings will be presented at the Conference on Human Factors in Computing Systems, in Paris. In the future, users should be able to design their own interfaces with WorldKit.
No comments:
Post a Comment
And what are your views on this?