Depth

Depth gives developers metric 3D awareness for mapping, measurement, navigation, and spatial AI—computed fully on-device for low latency and privacy.There are three different depth technologies that specific OAK devices utilise:

Stereo Depth

Stereo Depth estimates distance by comparing two camera views and triangulating pixel differences into real-world measurements. OAK cameras with RVC2 deliver highly accurate, configurable, RGB-aligned stereo depth, producing dense, colorized point clouds.

Neural Depth

OAK4 devices with RVC4 builds on the depth accuracy and extends it with on-device Neural Depth, which can run on its own or complement stereo depth to improve performance in challenging scenes.For the best of both worlds, combine neural and stereo depth with Neural Assisted Stereo, which pairs stereo accuracy with learned robustness.

ToF Depth

ToF Depth uses a modulated light pulse to measure the round-trip travel time of photons, giving reliable range on low-texture or low-light surfaces where stereo can struggle. It can only be utilized on ToF devices. Unlike stereo, ToF maintains a consistent error profile over distance, delivering predictable accuracy across the full range but at a cost of lower FPS.

Depth self-healing

If stereo depth gets distorted (eg. because of serious mechanical impact or calibration drift), DepthAI provides Dynamic Calibration with which you can setup your camera to continuously "self-heal". Additionally you can also resort to fixing stereo depth manually.

Typical use cases

Point clouds: generate colorized point clouds for mapping, inspection, or reconstruction.
Spatial AI: fuse depth with detections/landmarks to get XYZ targets for grasping or avoidance.
Navigation: pair depth with semantics to filter hazards and plan safe motion indoors/outdoors.

Code-less quick start with App Store

OAK Viewer

OAK Viewer is a GUI application that allows you to easily evaluate the camera by visualizing its output in real-time. You can try it out:

Open it on LuxonisHub

Guides and examples

StereoDepth example

Classical stereo with configurable modes

Neural Assisted Stereo

Classical stereo with added NeuralDepth for better performance

NeuralDepth examples

Upgrade your point clouds with neural depth

Time of Flight

Extract depth data from our Time of Flight sensor

Need assistance?

Head over to Discussion Forum for technical support or any other questions you might have.

ON THIS PAGE