microsoft / hololens-researchmode-unreal

An Unreal Engine game plugin which enables research mode on Microsoft's HoloLens 2.

Microsoft Hololens 2 Research Mode for Unreal Engine

What is the Microsoft Hololens 2 Research Mode plugin?

The Microsoft Hololens 2 Research Mode plugin is an Unreal Engine game plugin which provides access to key sensors available on Microsoft's HoloLens 2 for research applications.

NOTE: The Microsoft Hololens 2 Research Mode plugin requires Unreal 4.27.0+.

Feature Summary

The full feature list available is on the HoloLens Research Mode docs

The plugin can be used with the Microsoft-OpenXR or built-in Windows Mixed Reality plugins.

Installation

1. Install Unreal Engine from source. If you have never accessed Unreal Engine's source code before, instructions for joining the Epic Games organization on GitHub can be found here.
2. Download the Microsoft Microsoft Hololens 2 Research Mode plugin from the this repo.
3. Apply this restricted capabilities PR for UE4 or UE5 into your UE engine sources. Without this PR, a packaged app with the required capabilities can't be run on device.
4. Use your own HoloLens 2 project or the provided sample project.

Documenation

Links to further documentation can be found here

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

hololens-researchmode-unreal's Issues

Microphone support

Hi, is there a way to access the microphone of the HoloLens2 beside of the speech mappings?

Package for ARM

Added arm32 support for Research Mode.
https://docs.microsoft.com/en-us/hololens/hololens-release-notes#windows-holographic-version-20h2---january-2021-update

Is there a process in Unreal to package a Hololens2 Project for ARM32 and not ARM64?
I'm seeing this done in Unity only.

I change the Target Platform to Hololens.
(Target.Platform == UnrealTargetPlatform.HoloLens)

UATHelper: Packaging (HoloLens): Using ARM64 architecture for deploying to HoloLens device

is there a way to access the front facing camera in Unreal?

I see in the docs this allows for grabbing all the sensor cameras upper right and left Cameras and depth. But I can find no way to grab the front facing camera feed or even pull frames in Unreal.

Is this possible?

problem with open a project

Hello, I have a problem with open a project in UE 5.0:

What's wrong?

unreal 5 support

Broadcasting the sensors stream to PC

Hi,

I am working on a ML project and I want to use the data from the sensors ( especially the PV and AHAT sensors). Is there an option to broadcast the data in real time using tcp/udp and save it to my PC? I tried working with the stream recorder from the opencv4HoloLens2 repo but it is not scaleable, the storage in the device is capable of storing only 2-3 recordings of 2-3 minutes (and when the storage is full the app crashes without a warning and the record is corrupted).

Hope to get an helpful answer.
Thank in advance!
Eviatar.