PrimeSense 3D sensing technology is a layered solution, combining both hardware and software.
Depth Physical layer
The depth physical acquisition layer, includes the IR light projector, depth (IR) and color (RGB) CMOS image sensors and microphones. On top of that is the PrimeSense SoC.
The PrimeSense SoC operates the underlying hardware by handling functions such as, depth acquisition dedicated calculation; matching (registration) between the depth and RGB images; downsampling; mirroring; and more. The physical layer and the PrimeSense SoC are the elements that make up the PrimeSense Sensor Reference Design (RD) – the actual physical unit.
OpenNI is an open source framework supported by thousands of partners and developers worldwide. It works simultaneously with the Sensor, executing on the host side. This simple and open acquisition API enables the host to operate the Sensor and access all of the raw data it has gathered.
Computer Vision Middleware
NiTE™ (Natural Interface Technology for End-User) is the perception algorithms layer. It is the most advance and robust 3D computer vision available today, boasting a thin host, minimal CPU load, and multiplatform support. This middleware provides the application with a clear user control API, whether it is hand-based control or a full-body control. The algorithms utilize the depth, color, IR and audio information received from the hardware device, which enable them to perform functions such as hand locating and tracking; a scene analyzer (separation of users from background); accurate user skeleton joint tracking; various gestures recognition; and more.
NiTE key benefits:
- Thin host middleware for natural interface
- Wide range of gesture detectors
- Configurable, flexible and extendible by users of the OpenNI standard
- Multiplatform – Windows, Linux, Mac OS and Android
- Minimal CPU load, optimized for x86 and ARM architecture
- Proven mass-market scalability
In addition to NiTE algorithms, a very broad array of 3rd party middleware libraries and applications are available. These middleware solutions have been created by thousands of OpenNI developers and partners. These provide solutions such as object recognition, 3D analytics, 3D scanning, and many more.
For more information and download: www.OpenNI.orgNiTE brochure
NiTE™ 2 API Programmer Tutorial Guide