Windows 10: How Microsoft researchers are moving beyond keyboard and mouse

Brink · Jun 28, 2016

Kfir Karmon imagines a world in which a person putting together a presentation can add a quote or move an image with a flick of the wrist instead of a click of a mouse.

Jamie Shotton envisions a future in which we can easily interact in virtual reality much like we do in actual reality, using our hands for small, sophisticated movements like picking up a tool, pushing a button or squeezing a soft object in front of us.

And Hrvoje Benko sees a way in which those types of advances could be combined with simple physical objects, such as a few buttons on a piece of wood, to recreate complex, immersive simulators – replacing expensive hardware that people use today for those purposes.

Microsoft researchers are looking at a number of ways in which technology can start to recognize detailed hand motion — and engineers can put those breakthroughs to use in a wide variety of fields.

The ultimate goal: Allowing us to interact with technology in more natural ways than ever before.

“How do we interact with things in the real world? Well, we pick them up, we touch them with our fingers, we manipulate them,” said Shotton, a principal researcher in computer vision at Microsoft’s Cambridge, UK, research lab. “We should be able to do exactly the same thing with virtual objects. We should be able to reach out and touch them.”

This kind of technology is still evolving. But the computer scientists and engineers who are working on these projects say they believe they are on the cusp of making hand and gesture recognition tools practical enough for mainstream use, much like many people now use speech recognition to dictate texts or computer vision to recognize faces in photos.

That’s a key step in Microsoft’s broader goal to provide more personal computing experiences by creating technology that can adapt to how people move, speak and see, rather than asking people to adapt to how computers work.

“If we can make vision work reliably, speech work reliably and gesture work reliably, then people designing things like TVs, coffee machines or any of the Internet of Things gadgets will have a range of interaction possibilities,” said Andrew Fitzgibbon, a principal researcher with the computer vision group at the UK lab.

That will be especially important as computing becomes more ubiquitous and increasingly anticipates our needs, as opposed to responding to our commands. To make these kinds of ambient computing systems truly work well, experts say, they must be able to combine all our senses, allowing us to easily communicate with gadgets using speech, vision and body language together – just like we do when communicating with each other...

[youtube]QTz1zQAnMcU[/youtube]

[youtube]Jwk4iwpeVRU[/youtube]
Click to expand...

Read more: Talking with your hands: How Microsoft researchers are moving beyond keyboard and mouse - Next at Microsoft

:)

igibbwiz · Jun 28, 2016

mutli monitor mouse wrap in windows 10, edgeless, borderless

hello, has anyone figured out how to get multi monitor mouse wrap from for example, the right edge of the right most monitor, and move the mouse right and have the mouse move to the left side of the left most monitor, eg from monitor 3 to 1.

i have researched and a lot of people are asking for the opposite for gaming

MALIK YASIRNAWAZ · Jun 28, 2016

Microsoft designer keyboard and mouse are not functioning

Hi,

Fine, Thank you

Please Change power setting

For that you may follow these steps:

*Go to Device Manager.

*Right-click on the keyboard device and choose Properties in the context menu.

*In Properties dialog box, click the Power Management tab.

*Right-click on your keyboard and choose Properties in the context menu.

*Turn off the Allow the computer to turn off this device to save power option, and click OK button.

please try this solutions and the problem should resolve.

Please let me know, if that helps.

Kind Regards:

Engr. Malik Yasir

Phone Man · Jun 28, 2016

Down here is Southern Louisiana us Cajuns use our hands a lot when talking. If we put our hands in our pockets our mouth stops working.

We would drive a computer nuts if we get excited.

Jim *Dinesh

PerfectBlue · Jul 11, 2016

While I think that the idea of using gestures on a PC is pretty cool, and I do see some big things in the future for this kind of technology I don't think that it will ever come close to usefulness\ubiquity the keyboard\mouse interface.

We've had consumer level motion technology for a while, from motion controllers on the WII to the leap motion. The technology has improved a lot over the years and it's being used for a lot of innovative things. We've also had industrial motion controllers that are a league ahead of the consumer devices. But there is one thing that they all have in common. You can't use them for extended periods of time because the precision movements require will make your arms feel like they are going to drop off after a while.

When you're using a keyboard\mouse your forearms are supported, so it's easy to use them for 2-3 hours straight, but try using a leap motion for even simple tasks like browsing the web, and your arms will feel like led after a while.

dencal · Jul 11, 2016

This technology is not new....Leap have been working on this for some considerable time.
I bought the Leap Motion app and console at least a couple of years ago.
All motion is done by hand movements hovering above the console, no need to use a keyboard, mouse or tablet.

PerfectBlue · Apr 4, 2018

This technology is not new....Leap have been working on this for some considerable time.
I bought the Leap Motion app and console at least a couple of years ago.
All motion is done by hand movements hovering above the console, no need to use a keyboard, mouse or tablet.
Click to expand...

I toyed with the idea of getting one for digital painting, but at the end of the day the leap wasn't the right product for me as it's actually incredibly difficult to paint without having a solid surface to offer you resistance. Oh, and they make your arm feel like led after a while.

Windows 10: How Microsoft researchers are moving beyond keyboard and mouse

How Microsoft researchers are moving beyond keyboard and mouse

How Microsoft researchers are moving beyond keyboard and mouse

How Microsoft researchers are moving beyond keyboard and mouse

How Microsoft researchers are moving beyond keyboard and mouse - Similar Threads - Microsoft researchers are

Microsoft Keyboard & Mouse

Microsoft Keyboard & Mouse

Microsoft Keyboard & Mouse

Setting Mouse Speed Beyond Maximum

Setting Mouse Speed Beyond Maximum

Microsoft Sculpt Keyboard and Mouse - Beyond upset

Moving focus in macro created in Microsoft Mouse and Keyboard Center

Microsoft Research Collage maker

JavaScript moves forward in Microsoft Edge with ECMAScript 6 & beyond