Microsoft demonstrates technology that interacts with virtual objects on the screen via hand gestures

In an effort to turn the keyboard and mouse into the past, researchers at Microsoft are continuing to improve the technology of tracking and recognizing hand gestures, then apply to virtual reality devices. , as well as enhance the ability to control virtual objects on the screen. "We are focusing on accuracy, so users can feel simulated hands like their real hands," said Jamie Shotton, head of the research team at the computer vision lab. vision), of Microsoft UK, said. "This is a research topic for many years, but I think it's time to bring it to life and use."

Microsoft has just released two new videos, demonstrating their progress in hand gesture tracking technology. The first video shows that users can interact with widgets inside the screen, such as buttons, virtual keyboards, or even more accurately. Microsoft said those who have been testing this system feel like "they own the virtual hand". It's easy to imagine a new technique that can be used to create virtual instruments, or to control game tasks.

Technology interacts with virtual objects on the screen via hand gestures.

While Microsoft is investing heavily in virtual reality through HoloLens, the world's largest software maker also seems to want to add hand-gesture-based controls to the Windows platform. In 2013, Microsoft introduced the ability to manipulate Windows through the hands, thanks to a Kinect camera. This utility seems to have been included in a project called "Project Prague" by Microsoft, as seen in the second video. The goal of the project is to provide developers with hand gestures and ability to create gestures, for different applications.

Introducing the Project Project Prague.

Tracking Microsoft's hand gestures is just a project that is still in the research phase, which means they may not make it a reality in the future. In 2012, the company said it would invest in a "touchless" technology operated by virtual reality, a few years before HoloLens was born. Not all, but almost all of Microsoft's research projects then brought in real products, and sold it to consumers a few years after it was revealed.

Keyboards and mice are definitely still a long way from being "extinct", but if this project goes into practice, Microsoft is probably making the lifespan of these peripheral devices shrinking.