vvvv / vl.devices.kinect2

A package for using Kinect2 depth cameras by Microsoft in VL

VL.Devices.Kinect2

A package for using Kinect2 depth cameras by Microsoft in VL.

Try it with vvvv, the visual live-programming environment for .NET
Download: http://visualprogramming.net

Requirements:

• Kinect for Windows Runtime 2.0

Using the library

In order to use this library you'll have to install the nuget that is available via nuget.org. For information on how to use nugets with VL, see Managing Nugets in the documentation. As described there you go to the commandline and then type:

nuget install VL.Devices.Kinect2

Once the VL.Devices.Kinect2 nuget is installed and referenced in your VL document you'll see the category "Kinect2" under "Devices" in the nodebrowser.

Demos are available via the Help Browser!

Building from source

Beware there is an oddity required for building the included csproj:

• The csproj references https://www.nuget.org/packages/Microsoft.Kinect 2.0.1410.19000 which includes a reference .dll that can no longer be loaded with .NET6.0
• Therefore we added the actual lib (taken from the GAC) to \lib\net6.0\Microsoft.Kinect.dll for shipping with this NuGet

vl.devices.kinect2's Issues

Connected outuput

It would be great to have an output so it was possible to see if the kinect is connected. An IsConnected outputpin, perhaps with an ID if multiple kinects are connected

Investigate OpenMultiSourceFrameReader()

Support for pixel format R32G32_Float is needed in VL.Lib.Basics.Imaging

Output of RGBDepth and DepthRGB nodes is in R32G32_Float format, VL.Lib.Basics.Imaging does not support such fromat.

Runtime stops for Kinect2 help patches

Runtime stops for Kinect2 help patches

Enable/Disable functionality broken for all streams

After introducing the new infrastructure to handle Image memcopy properly using Subjects, previousy working Enable/Disable input pins in Kinect2 node stopped working. The Kinect sensor remains active even after deleting the nodes altogether. Only closing gamma seems to release the sensor.

Help patches don't open if Kinect Runtime is not installed