Windows 10: Using speech in your UWP apps: It’s good to talk

Brink · May 16, 2016

As developers, we adapt as technologies move from the realm of Science Fiction into readily available SDKs. That’s certainly, or perhaps especially, true for speech technologies. In the past 5 years, devices have become more personal and demanding of new forms of interaction.

In Windows 10, speech is front-and-center with the Cortana personal assistant, and the Universal Windows Platform (UWP) gives us several ways to plug into that “Hey, Cortana” experience. But there’s much more that we can do when working with speech from a UWP app and that’s true whether working locally on the device or remotely via the cloud.

In this 3-part series, we will dig in to some of those speech capabilities and show that speech can be both a powerful and a relatively easy addition to an app. This series will look at…

the basics of getting speech recognized

how speech recognition can be guided

how we can synthesize speech

additional capabilities in the cloud for our UWP apps

In today’s post, we’ll start with the basics.

Just because we can doesn’t always mean we should

Using a “natural” interaction mechanism like speech requires thought and depends on understanding users’ context:

What are they trying to do?

What device are they using?

What does sensor information tell us about their environment?

As an example, delivering navigation directions via speech when users are driving is helpful because their hands and eyes are tied up doing other things. It’s less of a binary decision, though, if the users are walking down their city streets with their devices held at arms’ length—speech might not be what they are looking for in this context.

Context is king, and it’s not easy to always get it right even with a modern device that’s packed with sensors. Consider your scenarios carefully and look at our guidance around these types of interactions before getting started...
Click to expand...

Read more: Using speech in your UWP apps: Its good to talk | Building Apps for Windows

:)

hadimassa · May 16, 2016

Nokia Vopi SIP - How to active Comfort Noise CN?

These (PCMU, PCMA, iLBC) are narrow band speech codecs used by VOIP apps like Google Talk. I really don't understand why you want to add noise when you've te advantage of such good speech quality.

Jaaggs · May 16, 2016

Any Speech to Text App for Windows Phone 7

is there any Speech to Text app for Windows Phone 7 / Samsung Focus out there?

And I'm NOT talking about how to use speech for search but to use speech to send text message instead or to use speech to take plain text note/One Note/Word etc...

Many thanks!

Windows 10: Using speech in your UWP apps: It’s good to talk

Using speech in your UWP apps: It’s good to talk

Using speech in your UWP apps: It’s good to talk

Using speech in your UWP apps: It’s good to talk - Similar Threads - Using speech UWP

Using speech to log in?

Using speech to log in?

Using speech to log in?

Use Cellular data for non UWP/WinUI apps

Can't use Uwp apps :

UWP Single App Kiosk - Activate Online Speech Recognition

From keyboard via Text-to-speech To Microphone Talk?

any good speech-to-text freeware?

Bringing your existing desktop apps to UWP