opencv/doc/tutorials/viz/transformations/transformations.rst

203 lines
5.7 KiB
ReStructuredText
Raw Normal View History

2013-09-08 00:23:26 +08:00
.. _transformations:
Transformations
***************
Goal
====
In this tutorial you will learn how to
.. container:: enumeratevisibleitemswithsquare
* How to use makeTransformToGlobal to compute pose
* How to use makeCameraPose and Viz3d::setViewerPose
* How to visualize camera position by axes and by viewing frustum
Code
====
You can download the code from :download:`here <../../../../samples/cpp/tutorial_code/viz/transformations.cpp>`.
2013-09-08 00:23:26 +08:00
.. code-block:: cpp
#include <opencv2/viz.hpp>
#include <iostream>
#include <fstream>
using namespace cv;
using namespace std;
/*
2013-09-08 00:23:26 +08:00
* @function cvcloud_load
* @brief load bunny.ply
*/
Mat cvcloud_load()
{
Mat cloud(1, 1889, CV_32FC3);
ifstream ifs("bunny.ply");
string str;
for(size_t i = 0; i < 12; ++i)
getline(ifs, str);
Point3f* data = cloud.ptr<cv::Point3f>();
float dummy1, dummy2;
for(size_t i = 0; i < 1889; ++i)
ifs >> data[i].x >> data[i].y >> data[i].z >> dummy1 >> dummy2;
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
cloud *= 5.0f;
return cloud;
}
/*
2013-09-08 00:23:26 +08:00
* @function main
*/
int main(int argn, char **argv)
2013-09-18 19:50:55 +08:00
{
2013-09-08 00:23:26 +08:00
if (argn < 2)
{
cout << "Usage: " << endl << "./transformations [ G | C ]" << endl;
return 1;
}
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
bool camera_pov = (argv[1][0] == 'C');
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Create a window
viz::Viz3d myWindow("Coordinate Frame");
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Add coordinate axes
2013-09-15 22:26:53 +08:00
myWindow.showWidget("Coordinate Widget", viz::WCoordinateSystem());
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Let's assume camera has the following properties
Point3f cam_pos(3.0f,3.0f,3.0f), cam_focal_point(3.0f,3.0f,2.0f), cam_y_dir(-1.0f,0.0f,0.0f);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// We can get the pose of the cam using makeCameraPose
Affine3f cam_pose = viz::makeCameraPose(cam_pos, cam_focal_point, cam_y_dir);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// We can get the transformation matrix from camera coordinate system to global using
/// - makeTransformToGlobal. We need the axes of the camera
Affine3f transform = viz::makeTransformToGlobal(Vec3f(0.0f,-1.0f,0.0f), Vec3f(-1.0f,0.0f,0.0f), Vec3f(0.0f,0.0f,-1.0f), cam_pos);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Create a cloud widget.
Mat bunny_cloud = cvcloud_load();
2013-09-15 22:26:53 +08:00
viz::WCloud cloud_widget(bunny_cloud, viz::Color::green());
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Pose of the widget in camera frame
Affine3f cloud_pose = Affine3f().translate(Vec3f(0.0f,0.0f,3.0f));
/// Pose of the widget in global frame
Affine3f cloud_pose_global = transform * cloud_pose;
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Visualize camera frame
if (!camera_pov)
{
2013-09-15 22:26:53 +08:00
viz::WCameraPosition cpw(0.5); // Coordinate axes
viz::WCameraPosition cpw_frustum(Vec2f(0.889484, 0.523599)); // Camera frustum
2013-09-08 00:23:26 +08:00
myWindow.showWidget("CPW", cpw, cam_pose);
myWindow.showWidget("CPW_FRUSTUM", cpw_frustum, cam_pose);
}
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Visualize widget
myWindow.showWidget("bunny", cloud_widget, cloud_pose_global);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Set the viewer pose to that of camera
if (camera_pov)
myWindow.setViewerPose(cam_pose);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// Start event loop.
myWindow.spin();
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
return 0;
}
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
Explanation
===========
Here is the general structure of the program:
* Create a visualization window.
.. code-block:: cpp
/// Create a window
viz::Viz3d myWindow("Transformations");
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* Get camera pose from camera position, camera focal point and y direction.
.. code-block:: cpp
/// Let's assume camera has the following properties
Point3f cam_pos(3.0f,3.0f,3.0f), cam_focal_point(3.0f,3.0f,2.0f), cam_y_dir(-1.0f,0.0f,0.0f);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
/// We can get the pose of the cam using makeCameraPose
Affine3f cam_pose = viz::makeCameraPose(cam_pos, cam_focal_point, cam_y_dir);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* Obtain transform matrix knowing the axes of camera coordinate system.
.. code-block:: cpp
/// We can get the transformation matrix from camera coordinate system to global using
/// - makeTransformToGlobal. We need the axes of the camera
Affine3f transform = viz::makeTransformToGlobal(Vec3f(0.0f,-1.0f,0.0f), Vec3f(-1.0f,0.0f,0.0f), Vec3f(0.0f,0.0f,-1.0f), cam_pos);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* Create a cloud widget from bunny.ply file
.. code-block:: cpp
/// Create a cloud widget.
Mat bunny_cloud = cvcloud_load();
2013-09-15 22:26:53 +08:00
viz::WCloud cloud_widget(bunny_cloud, viz::Color::green());
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* Given the pose in camera coordinate system, estimate the global pose.
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
.. code-block:: cpp
/// Pose of the widget in camera frame
Affine3f cloud_pose = Affine3f().translate(Vec3f(0.0f,0.0f,3.0f));
/// Pose of the widget in global frame
Affine3f cloud_pose_global = transform * cloud_pose;
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* If the view point is set to be global, visualize camera coordinate frame and viewing frustum.
.. code-block:: cpp
/// Visualize camera frame
if (!camera_pov)
{
2013-09-15 22:26:53 +08:00
viz::WCameraPosition cpw(0.5); // Coordinate axes
viz::WCameraPosition cpw_frustum(Vec2f(0.889484, 0.523599)); // Camera frustum
2013-09-08 00:23:26 +08:00
myWindow.showWidget("CPW", cpw, cam_pose);
myWindow.showWidget("CPW_FRUSTUM", cpw_frustum, cam_pose);
}
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* Visualize the cloud widget with the estimated global pose
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
.. code-block:: cpp
/// Visualize widget
myWindow.showWidget("bunny", cloud_widget, cloud_pose_global);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
* If the view point is set to be camera's, set viewer pose to **cam_pose**.
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
.. code-block:: cpp
/// Set the viewer pose to that of camera
if (camera_pov)
myWindow.setViewerPose(cam_pose);
2013-09-18 19:50:55 +08:00
2013-09-08 00:23:26 +08:00
Results
=======
#. Here is the result from the camera point of view.
.. image:: images/camera_view_point.png
:alt: Camera Viewpoint
:align: center
#. Here is the result from global point of view.
.. image:: images/global_view_point.png
:alt: Global Viewpoint
:align: center