Windows 10: Is there anyway to live stream sensor data on HoloLens 2?

Mya16 · Feb 4, 2023

I have switched my HoloLens into Research mode and used the SensorVisualization and StreamRecorder applications available at https://github.com/microsoft/HoloLens2ForCV/tree/main/Samples. However, I was wonder if there is anyway to live stream this sensor information to my computer? With the StreamRecorder application the information is saved into File Explorer which I have been able to access through the Window's Device Portal. Is there a way I can see this data in real-time instead of downloading it after the fact?

:)

ScientistCrazy · Feb 4, 2023

Hololens sensors driver Bug

Ok. I have done it already.

Do you know how to restrict driver auto installation for Hololens Sensor?

Brink · Feb 4, 2023

Using Cortana Intelligence in HoloLens Applications

Telemetry plays an important role when you operationalize new experiences/apps that span the web, mobile and IoT, including new gadgets such as the Microsoft HoloLens. The abundance of data that is made available can help developers monitor and track system health and usage patterns, and provide important new insights into how users interact with your application. Tapping into this wealth of information can really help you align your customers’ experiences with their needs and expectations.

At the , we showed the future of home improvement as envisioned by Lowe’s and Microsoft. As part of this experience, we showed how to use telemetry emitted by HoloLens to understand the [virtual] places that customers are gazing at, as they experience an immersive home remodeling experience in 3D, using the augmented reality capabilities of HoloLens.

Kitchen remodeling experience with HoloLens.

Heat map based on HoloLens telemetry data.

In this post, we show how you can use the Cortana Intelligence Suite to ingest data from the HoloLens application, analyze it in real-time using Azure Stream Analytics, and visualize it with Power BI.

Empowering HoloLens Developers with Cortana Intelligence

In HoloLens applications, users can interact through one of these methods:

By gazing at an object.

By using hand gestures.

By using voice commands.

When wearing, and interacting with, the HoloLens, a frontal camera tracks head movements, including the “head ray” and focus. The point that is being looked at is reflected using a cursor as a visual cue. These interactions are handled by the Update method (part of the MonoBehavior class). This method gets called at the refresh rate frequency, usually 60 frames per second. It’s crucial to not slow down the update process with any side operations.

We set out with a simple goal that HoloLens developers should be able to use the Cortana Intelligence Suite and any related Azure services with just a few lines of code. In this example, you can see the code in one of the Update methods that tracks the gaze of the HoloLens user. To use Cortana Intelligence, the HoloLens application needs to just add this one line:

logger.AddGazeEvent(FocusedObject.gameObject.name)

The HoloLens is now able to send telemetry data to Event Hub, and you can further analyze the data using various Azure Services, for instance, Azure Stream Analytics.

Calling the telemetry AddGazeEvent from the HoloLens app.

Building the End to End Solution

A canonical telemetry processing pipeline consists of the following:

An Event Hub that enables the ingestion of data from the HoloLens client application.

A Stream Analytics job that consumes the telemetry data, analyzes it real time, and writes the insights derived into Power BI, as an output.

A PowerBI dashboard.

If you don’t have an Azure account yet, you can obtain a free account which will help you follow along in this post. Azure provides a rich set of libraries that developers can use to interact its many services. When using these libraries with a HoloLens application (which is a Universal Windows App), you will not be able to use NuGet packages directly if they rely on the .NET full framework implementation. Additionally, Azure services provide REST interfaces for client communication.

In our case, to send telemetry data from the HoloLens to the Event Hub, we implemented a .NET library, using the core .NET framework to meet the UWP apps requirements. The DLL handles the batching of events and composing of the request payload, and takes care of network retries.

Initializing the Telemetry Library

Step-by-step instructions on how to set up the Azure services and send data to the Azure Event Hub with retries from the UWP app can be found in GitHub here. Additional resources that you may find useful are included below. We would love to hear from you, so do let us know what you think – you can send your feedback via the comments section below.

Scott & Senja

Resources:

Get Started with Microsoft Azure

Get started with Azure Event Hubs

Get started with Azure Stream Analytics to process data from IoT devices

The Holographic Academy

Click to expand...

Source: Using Cortana Intelligence in HoloLens Applications | Cortana Intelligence and Machine Learning Blog

Brink · Feb 4, 2023

Introducing Windows Autopilot for HoloLens 2

In addition to supporting the deployment and management of Windows 10 devices like laptops, tablets, and desktops, we are taking Windows Autopilot to uncharted territory by introducing the private preview of Windows Autopilot deployment for HoloLens 2!

Since Windows Autopilot was first introduced with Windows 10, version 1703, it has come a long way to enable organizations to deploy and manage their Windows 10 devices in significant less time and at noticeable cost savings. At its core, Windows Autopilot is a set of cloud technologies that offers greater efficiency and automation over traditional deployment and setup experiences.

As a critical component of Microsoft Endpoint Manager and our commitment to empowering IT, Windows Autopilot is designed to meet you where you are in your journey to simplified endpoint management and help you get where you want to be. We started with deployment scenarios for Azure AD then, in response to your feedback, Hybrid AD Join. In the spirit of innovation, we are working to support a broader range of devices with Windows Autopilot, starting with HoloLens 2.

Introducing Windows Autopilot for HoloLens 2

Microsoft HoloLens 2 is an untethered holographic computer with apps and solutions that help people across organizations learn, work, communicate, and collaborate more effectively using mixed reality. HoloLens 2 devices are commercial-ready with support for Azure AD, mobile device management (MDM), kiosk mode, always-on BitLocker, Windows Update for Business, and Microsoft Store for Business.

As adoption of HoloLens 2 is increasing, medical and educational institutions have found that deploying these devices at scale is challenging, time-consuming, and costly. Imagine an IT admin putting a HoloLens 2 device, calibrating the device, then moving through all the decision-making steps, such as user id and password, to join the device to their tenant. Now repeat this process for every device they need to deploy in their organization.

Windows Autopilot for HoloLens 2 with Microsoft Endpoint Manager solves this problem and delivers on the same promise of efficiency, simplified deployment, and streamlined device security and endpoint management as other Windows Autopilot deployment scenarios, driving significant cost and time savings for your organization.

How Windows Autopilot for HoloLens 2 works

With the current private preview, Windows Autopilot for HoloLens 2 support self-deploying mode with Azure AD only. That means the deployment process looks like this:

Join the device to Azure AD.

Enroll in Microsoft Endpoint Manager/Microsoft Intune (or another MDM service), leveraging Azure AD for automatic MDM enrollment to begin downloading all device targeted policies, user targeted applications, certificates, and networking profiles.

Land a shared device login state for the user with zero interaction.

Here is an illustration of Windows Autopilot self-deployment for HoloLens 2 devices:

The deployment scenarios currently supported with the private preview of Windows Autopilot for HoloLens 2 are as follows:

Azure AD join

Self-deployment mode

MDM enrollment with polices, certificates, kiosk mode, etc. applied during deployment

Device name setup before Azure AD join

Preset keyboard language from list of HoloLens 2 supported languages

Windows Autopilot can be used with HoloLens 2 devices with Windows 10 build 19041.1002.200107-0909 or later, and an internet connection.

Registering a HoloLens 2 device with Windows Autopilot

In the coming months, HoloLens 2 devices will be shipped as "Windows Autopilot ready" and have a Windows product key ID (PKID) barcode printed on the outside of the box. This PKID will simplify Windows Autopilot device registration by allowing distributors and resellers to register HoloLens 2 devices with their customers' tenants without powering on the actual devices. To learn more about how this process works, see adding devices to Windows Autopilot.

HoloLens 2 hardware ID collection for Windows Autopilot

We have also simplified the process of collecting the hardware ID (also referred to as hardware hash) and diagnostic logs for HoloLens 2 devices. There is no need to run a PowerShell script to collect the hardware ID or diagnostic logs during setup. With HoloLens 2 devices, you can simply collect logs and hardware IDs by following these simple steps:

While the HoloLens 2 device is powered on, press and release the Power and Volume down buttons together to trigger the hardware ID and diagnostic log collection process.

Connect the HoloLens 2 device to a PC using a USB cable so that it shows up in File Explorer.

Browse to Internal Storage > Documents and extract AutopilotDiagnostics.zip. This file/folder will contain a CSV file with a a file name that begins “DeviceHash…”.

Getting started with the private preview of Windows Autopilot for HoloLens 2

If you are interested in joining the private preview, here is the process:

Make sure your organization meets all requirements for Windows Autopilot and self-deploying mode, which include networking, licensing, and configuration requirements.

Enroll in the Windows Autopilot for HoloLens 2 private preview program by visiting Microsoft Forms, or scanning this QR code:

We will send you confirmation when your tenant is accepted into the program.

Follow the instructions documented in this Windows Autopilot for HoloLens 2 evaluation guide. If your organization is using Microsoft Endpoint Manager and Windows Autopilot, most steps will not be new to you, but this guide will take you the process step by step.

We look forward to hearing your feedback on the Windows Autopilot for HoloLens 2 private preview and thank you in advance for your interest and participation!
Click to expand...

Source: https://techcommunity.microsoft.com/...2/ba-p/1371494

Tweet

— Twitter API (@user) View on Twitter
Click to expand...

Windows 10: Is there anyway to live stream sensor data on HoloLens 2?

Is there anyway to live stream sensor data on HoloLens 2?

Is there anyway to live stream sensor data on HoloLens 2?

Is there anyway to live stream sensor data on HoloLens 2?

Is there anyway to live stream sensor data on HoloLens 2? - Similar Threads - anyway live stream

Is there anyway to live stream sensor data on HoloLens 2?

live tv streaming

Is there anyway to have 2 live Internet connections simultaneously and...

Live stream won't go live

live stream buffering

Hololens sensors driver Bug

Sportsfeista Is The Best live streaming site

no sound on live streaming

live stream on PC