Windows 10: Cognitive Toolkit Model Evaluation in UWP

Brink · Aug 31, 2017

We are excited the share with you that Microsoft Cognitive Toolkit (CNTK) 2.1 has added support for model evaluation on UWP applications. This means you can harness the power of deep learning in your Windows apps delivered via the Windows Store! Read on to find out how can infuse your apps with the power of AI.

The Virtuous Intelligence Cycle

Cloud-connected devices can perform operations locally or delegate them to the cloud. The virtually unlimited compute power of the cloud makes it a good choice for running tasks that need significant compute power but don’t require low latency. In machine learning, model training is an example of such a task. It might require hours or days to train a model, but once the model is trained, deploying it closer to where the data is generated has some very useful properties. First, it reduces the roundtrip latency inherently unavoidable in cloud communication. This is critical for time-sensitive deep learning scenarios like self-driving cars and industrial equipment failure detection. Second, it can unlock insights from data that were previously discarded due to network transmission costs. And finally, it allows machine learning solutions in scenarios with intermittent network connectivity like search & rescue, agriculture and others.

We refer to devices with non-trivial compute power that are in closer proximity to the data source as “intelligent edge” devices. Intelligent edge devices can vary broadly depending on scenario as shown in the figure below.

In the virtuous intelligence cycle, deep learning models trained in the cloud are deployed and evaluated at the edge. Additionally, the edge feeds valuable data back to the cloud where the models are improved and redeployed to the edge, hence completing the virtuous cycle.

The improvements described in this post allow UWP applications to be part of the intelligent edge where deep learning models can be evaluated.

Image Classification Example

Let’s look at an example where an image classification machine learning model is built into an UWP application. The app allows you to pick a CNTK compatible model to perform image classification on an image. Several pre-trained models to use for this purpose are available at this link.

The code for the entire solution is available in the CNTK Github repo.

Currently, only C++ CNTK UWP bindings are supported. However, the sample demonstrates how a C# based UWP solution can perform model evaluation by referencing a WinRT library that wraps the UWP-compatible CNTK native components available on NuGet.

packages.config specifies the NuGet packages the library uses, and points to the UWP-compatible package:

1
2
3
4
5 <?xml version="1.0" encoding="utf-8"?>
<packages>
<package id="CNTK.UWP.CPUOnly" version="2.1.0" targetFramework="native" />
</packages>
This NuGet package provides UWP-compatible CNTK components, including the OpenBLAS math library, for CPU-based model evaluation. ImageRecognizerLib exposes Create and RecognizeObjectAsync methods used to load the pre-trained CNTK model and classify the specified image input as an array of bytes.

The rest of the solution is a few simple XAML UI elements to accept input from the user. Here is a quick animation of the app in action:

Now it’s your turn!

We’ve demonstrated how you can use the newly added UWP support in CNTK to bring the next level of intelligence to your Windows applications. We can’t wait to see the awesome apps you will build with this exciting new technology!
Click to expand...

Source: Cognitive Toolkit Model Evaluation in UWP - Building Apps for Windows

:)

linnea__ · Aug 31, 2017

Phone Recording!

Is there any likelyhood that I'll maybe can find something in
http://store.ovi.com/ ?

I'm not able to search myself. Bad cognition.

Roharashraj™ · Aug 31, 2017

Microsoft will be charging for Windows update!

Microsoft has introduce "Windows Universal App"

Microsoft introduce Windows 10 for the betterment of Developers & Consumers.

A Universal Windows Platform (UWP) app is a Windows experience that is built upon the Universal Windows Platform (UWP), which was first introduced in Windows 8 as the Windows Runtime. At the core of UWP apps is the idea that users want their
experiences to be mobile across ALL their devices, and they want to use whatever device is most convenient or productive for the task at hand.

Windows 10 makes it easier to develop apps for the UWP with just one API set, one app package, and one store to reach all Windows 10 devices – PC, tablet, phone, Xbox, HoloLens, Surface Hub and more. It’s easier to support a number of screen sizes, and also
a variety of interaction models, whether it be touch, mouse and keyboard, a game controller, or a pen.

The bottom line: You can spend your time working with familiar programming languages and APIs, all in single project, and have the very same code run on the huge range of Windows hardware that exists today.

You may read an entire article at Microsoft Developer Network,
Click Here

Josey Wales · Aug 31, 2017

Artificial Intelligence (AI) is just around the corner..

Windows 10: Cognitive Toolkit Model Evaluation in UWP

Cognitive Toolkit Model Evaluation in UWP

Cognitive Toolkit Model Evaluation in UWP

Cognitive Toolkit Model Evaluation in UWP

Cognitive Toolkit Model Evaluation in UWP - Similar Threads - Cognitive Toolkit Model

New name for UWP Community Toolkit: Windows Community Toolkit

The UWP Community Toolkit v2.0

The UWP Community Toolkit v2.1

Introducing the UWP Community Toolkit

The UWP Community Toolkit v2.2

Announcing UWP Community Toolkit 1.5

Announcing UWP Community Toolkit 1.4

Announcing UWP Community Toolkit 1.3

Announcing UWP Community Toolkit 1.2