katsunori-waragai / zed-sdk

⚡️The spatial perception framework for rapidly building smart robots and spaces

ZED SDK

The ZED SDK is a cross-platform library designed to get the best out of the ZED cameras.
In this project, we provide tutorials and code samples to get started using the ZED SDK API.

Website · Store · API Reference · Community · Blog

---

🎉 The ZED SDK 4.0 is released! We support the ZED X and ZED X Mini cameras, added the Fusion API for multi-camera Body Tracking, and more! Please check the Release Notes of the latest version for more details.

Overview

Depth Sensing	Object Detection	Body Tracking

Positional Tracking	Geo Tracking	Spatial Mapping

Camera Control	Plane Detection	Multi Camera Fusion

Why ZED?

• 🎯 End-to-end spatial perception platform for human-like sensing capabilities.
• ⚡ Real-time performance: all algorithms of the ZED SDK are designed and optimized to run in real-time.
• 📷 Reduce time-to-market with our comprehensive, ready-to-use hardware and software designed for multiple applications.
• 📖 User-friendly and intuitive, with easy-to-use integrations and well-documented API for streamlined development.
• 🛠️ Wide range of supported platforms, from desktop to embedded PCs.

Getting started

The ZED SDK contains all the libraries that power your camera along with tools that let you experiment with its features and settings.

To get started:

• Get a ZED from the Stereolabs Store
• Download the ZED SDK
• Install the ZED SDK on Windows, Linux or Jetson
• Start experimenting with the ZED SDK's tutorials

The documentation and API reference are great starting points to learn more about the ZED SDK and its many modules.

Samples

This repository contains ready-to-use and samples to start using the ZED SDK with only a few lines of code. They are organized by ZED SDK module:

• Tutorials - A series of basic tutorials that demonstrate the use of each API module.

• Camera Control - This sample shows how to adjust the ZED camera parameters.

• Camera Streaming - This sample shows how to stream and receive on local network the ZED's video feed.

• Depth Sensing - This sample shows how to capture a 3D point cloud and display with OpenGL. It also shows how to save depth data in different formats.

• Positional Tracking - This sample shows how to use positional tracking and display the result with OpenGL.

• GeoTracking - This sample shows how to fuse the ZED SDK's positional tracking with GNSS data for global positioning.

• Spatial Mapping - This sample shows how to capture 3D meshes with the ZED and display it with OpenGL. Classic Mesh and Point Cloud fusion are available.

• Object Detection - This sample shows how to use the Object Detection API module with the ZED.

• Body Tracking - This sample shows how to use the Body Tracking API with the ZED.

• Recording - This sample shows how to record and playback video files in SVO format. SVO files let you use all the ZED SDK features without having a ZED connected.

Supported platforms

Here is the list of all supported operating systems for the latest version of the ZED SDK. Please find the recommended specifications to make sure your configuration is compatible with the ZED SDK.

Ubuntu LTS	Windows	Jetson

The ZED SDK requires the use of an NVIDIA GPU with a Compute Capability > 5.

If you are not familiar with the corresponding versions between NVIDIA JetPack SDK and Jetson Linux, please take a look at our blog post.

Integrations

The ZED SDK can be easily integrated into projects using the following programming languages:

C++	Python	C#	C

Thanks to its comprehensive API, ZED cameras can be interfaced with multiple third-party libraries and environments.

Unity	Unreal Engine 5	OpenCV	ROS	ROS 2

Pytorch	YOLO	Matlab	Isaac SIM	Touch Designer

ZED Hub

Experience ZED like never before with ZED Hub, Stereolabs' IoT platform allowing easy management of camera fleets and data aggregation, fully managed on the cloud. Unlike competitors, ZED Hub offers plug-and-play functionality and dedicated features for your applications developed with the ZED SDK. ZED Hub simplifies the integration of 3D perception, offering remote access and monitoring to your cameras . Start for Free now!

Community

Join the conversation and connect with other ZED SDK users to share ideas, solve problems, and help make the ZED SDK awesome. Our aim is to make it extremely convenient for everyone to communicate with us.

• Discourse is our forum where all ZED users can connect. This is the best place to brainstorm and exchange about ZED cameras, ZED SDK software, and other Stereolabs products. Feel free to create an account and ask your questions, or even share your awesome projects!

• Twitter Follow Stereolabs @Stereolabs3D for official news and release announcements.

• GitHub If you come across a bug, please raise an issue in this GitHub repository.

• Email To talk to Stereolabs directly, the easiest way is by email. Get in touch with us at [email protected].