mirror of
https://github.com/opencv/opencv.git
synced 2025-01-11 15:08:08 +08:00
bd1f9cd1ed
Add videocapture_depth.cpp sample #25410 The PR is to combine the examples `videocapture_openni.cpp`, `videocapture_realsense.cpp` and `videocapture_obsensor.cpp` into `videocapture_depth.cpp`. Tested cameras and OS using this sample are listed below: | | Windows 10 | Ubuntu 22.04 | Mac M1 14.3 | |------------------------|--------------|--------------|---------------| | Orbbec Gemini 2 Series | ✓ | ✓ | ✓ | | RealSense D435, D455 | ✓ | ✓ | ✗ | | Kinect, XtionPRO | - | - | - | Note: - OpenNI based cameras (Kinect, XtionPRO) are not tested as I don't have them. - RealSense D435 and D455 don't work on Mac with OpenCV.
89 lines
3.5 KiB
Markdown
89 lines
3.5 KiB
Markdown
Using Creative Senz3D and other Intel RealSense SDK compatible depth sensors {#tutorial_intelperc}
|
|
=======================================================================================
|
|
|
|
@tableofcontents
|
|
|
|
@prev_tutorial{tutorial_orbbec_astra_openni}
|
|
@next_tutorial{tutorial_wayland_ubuntu}
|
|
|
|
|
|
|
|
**Note**: This tutorial is partially obsolete since PerC SDK has been replaced with RealSense SDK
|
|
|
|
Depth sensors compatible with Intel® RealSense SDK are supported through VideoCapture
|
|
class. Depth map, RGB image and some other formats of output can be retrieved by using familiar
|
|
interface of VideoCapture.
|
|
|
|
In order to use depth sensor with OpenCV you should do the following preliminary steps:
|
|
|
|
-# Install Intel RealSense SDK 2.0 (from here <https://github.com/IntelRealSense/librealsense>).
|
|
|
|
-# Configure OpenCV with Intel RealSense SDK support by setting WITH_LIBREALSENSE flag in
|
|
CMake. If Intel RealSense SDK is found in install folders OpenCV will be built with
|
|
Intel Realsense SDK library (see a status LIBREALSENSE in CMake log).
|
|
|
|
-# Build OpenCV.
|
|
|
|
VideoCapture can retrieve the following data:
|
|
|
|
-# data given from depth generator:
|
|
- CAP_INTELPERC_DEPTH_MAP - each pixel is a 16-bit integer. The value indicates the
|
|
distance from an object to the camera's XY plane or the Cartesian depth. (CV_16UC1)
|
|
- CAP_INTELPERC_UVDEPTH_MAP - each pixel contains two 32-bit floating point values in
|
|
the range of 0-1, representing the mapping of depth coordinates to the color
|
|
coordinates. (CV_32FC2)
|
|
- CAP_INTELPERC_IR_MAP - each pixel is a 16-bit integer. The value indicates the
|
|
intensity of the reflected laser beam. (CV_16UC1)
|
|
|
|
-# data given from RGB image generator:
|
|
- CAP_INTELPERC_IMAGE - color image. (CV_8UC3)
|
|
|
|
In order to get depth map from depth sensor use VideoCapture::operator \>\>, e. g. :
|
|
@code{.cpp}
|
|
VideoCapture capture( CAP_REALSENSE );
|
|
for(;;)
|
|
{
|
|
Mat depthMap;
|
|
capture >> depthMap;
|
|
|
|
if( waitKey( 30 ) >= 0 )
|
|
break;
|
|
}
|
|
@endcode
|
|
For getting several data maps use VideoCapture::grab and VideoCapture::retrieve, e.g. :
|
|
@code{.cpp}
|
|
VideoCapture capture(CAP_REALSENSE);
|
|
for(;;)
|
|
{
|
|
Mat depthMap;
|
|
Mat image;
|
|
Mat irImage;
|
|
|
|
capture.grab();
|
|
|
|
capture.retrieve( depthMap, CAP_INTELPERC_DEPTH_MAP );
|
|
capture.retrieve( image, CAP_INTELPERC_IMAGE );
|
|
capture.retrieve( irImage, CAP_INTELPERC_IR_MAP);
|
|
|
|
if( waitKey( 30 ) >= 0 )
|
|
break;
|
|
}
|
|
@endcode
|
|
For setting and getting some property of sensor\` data generators use VideoCapture::set and
|
|
VideoCapture::get methods respectively, e.g. :
|
|
@code{.cpp}
|
|
VideoCapture capture(CAP_REALSENSE);
|
|
capture.set( CAP_INTELPERC_DEPTH_GENERATOR | CAP_PROP_INTELPERC_PROFILE_IDX, 0 );
|
|
cout << "FPS " << capture.get( CAP_INTELPERC_DEPTH_GENERATOR+CAP_PROP_FPS ) << endl;
|
|
@endcode
|
|
Since two types of sensor's data generators are supported (image generator and depth generator),
|
|
there are two flags that should be used to set/get property of the needed generator:
|
|
|
|
- CAP_INTELPERC_IMAGE_GENERATOR -- a flag for access to the image generator properties.
|
|
- CAP_INTELPERC_DEPTH_GENERATOR -- a flag for access to the depth generator properties. This
|
|
flag value is assumed by default if neither of the two possible values of the property is set.
|
|
|
|
For more information please refer to the example of usage
|
|
[videocapture_depth.cpp](https://github.com/opencv/opencv/tree/5.x/samples/cpp/videocapture_depth.cpp)
|
|
in opencv/samples/cpp folder.
|