satoshirobatofujimoto / hololensartoolkit

Marker tracking using the front-facing camera of HoloLens and Unity3D, with a wrapper of ARToolKit built for UWP (Windows Universal Platform)

HoloLens with ARToolKit

Author: Long Qian

Date: 2017-01-24

Overview

HoloLensARToolKit is a successful experiment to integrate ARToolKit with HoloLens, or generally UWP (Universal Windows Platform).

With fiducial marker tracking provided by ARToolKit, plus the indoor localization of HoloLens, many Augmented Reality applications would be made possible.

This repository contains:

• Wrapper of ARToolKit5 for UWP
• Unity package to interface the native library
• A sample Unity application to demo the use of them
• Camera calibration of HoloLens

Example

Following are two screenshots taken in HoloLens Device Portal:

Multiple Marker Tracking	Cube Marker Tracking

The top-left 2D plane visualizes the current camera frame. Frame rate of rendering and frame rate of tracking are displayed on the top-right corner.

Run the sample

1. Make sure you have HoloLens development tools installed.
   • HoloLens Emulator and Vuforia are not required.
2. Launch Unity3D, open project folder HoloLensARSample.
3. Import the unity package ARToolKitUWP.unitypackage.
4. Open one of the sample scenes
   • Assets/Sample/HoloLensARToolKitSingle.unity
   • Assets/Sample/HoloLensARToolKitMulti.unity
   • Assets/Sample/HoloLensARToolKitCube.unity
5. Configure HoloLens deployment settings and deploy to HoloLens.
   • See Chapter 4 and 5 of Holograms 100.
6. Prepare the correspondent printed marker of ARToolKit.
7. See the effect.
   • HoloLens clicker is able to tune the visualization of camera frame image.

---

Understand HoloLensARToolKit

• My blog post
• Coordinate systems in HoloLensARToolKit
• Unity native programming

Do more with HoloLensARToolKit

• Integrate HoloLensARToolKit package with your application.
• Customize native library of ARToolKitUWP.
• Customize Unity package ARToolKitUWP-Unity.
• Calibrate your HoloLens camera.

---

License

HoloLensARToolKit is composed of two separate projects: ARToolKitUWP and ARToolKitUWP-Unity (including samples). Both of them are open for use in compliance with GNU Lesser General Public License (LGPL v3.0). Please see COPYING and COPYING.LESSER for license details.

ARToolKitUWP is a modified version of ARToolKit, statically links against ARToolKit binaries, and therefore complies with the license restrictions of ARToolKit (see details).