mirror of
https://github.com/opencv/opencv.git
synced 2024-12-15 01:39:10 +08:00
bae9cef0b5
Moving RGBD parts to 3d * files moved from rgbd module in contrib repo * header paths fixed * perf file added * lapack compilation fixed * Rodrigues fixed in tests * rgbd namespace removed * headers fixed * initial: rgbd files moved to 3d module * rgbd updated from latest contrib master; less file duplication * "std::" for sin(), cos(), etc. * KinFu family -> back to contrib * paths & namespaces * removed duplicates, file version updated * namespace kinfu removed from 3d module * forgot to move test_colored_kinfu.cpp to contrib * tests fixed: Params removed * kinfu namespace removed * it works without objc bindings * include headers fixed * tests: data paths fixed * headers moved to/from public API * Intr -> Matx33f in public API * from kinfu_frame.hpp to utils.hpp * submap: Intr -> Matx33f, HashTSDFVolume -> Volume; no extra headers * no RgbdFrame class, no Mat fields & arg -> InputArray & pImpl * get/setPyramidAt() instead of lots of methods * Mat -> InputArray, TMat * prepareFrameCache: refactored * FastICPOdometry: +truncate threshold, +depthFactor; Mat/UMat choose * Mat/UMat choose * minor stuff related to headers * (un)signed int warnings; compilation minor issues * minors: submap: pyramids -> OdometryFrame; tests fix; FastICP minor; CV_EXPORTS_W for kinfu_frame.hpp * FastICPOdometry: caching, rgbCameraMatrix * OdometryFrame: pyramid%s% -> pyramids[] * drop: rgbCameraMatrix from FastICP, RGB cache mode, makeColoredFrameFrom depth and all color-functions it calls * makeFrameFromDepth, buildPyramidPointsNormals -> from public to internal utils.hpp * minors * FastICPOdometry: caching updated, init fields * OdometryFrameImpl<UMat> fixed * matrix building fixed; minors * returning linemode back to contrib * params.pose is Mat now * precomp headers reorganized * minor fixes, header paths, extra header removed * minors: intrinsics -> utils.hpp; whitespaces; empty namespace; warning fixed * moving declarations from/to headers * internal headers reorganized (once again) * fix include * extra var fix * fix include, fix (un)singed warning * calibration.cpp: reverting back * headers fix * workaround to fix bindings * temporary removed wrappers * VolumeType -> VolumeParams * (temporarily) removing wrappers for Volume and VolumeParams * pyopencv_linemod -> contrib * try to fix test_rgbd.py * headers fixed * fixing wrappers for rgbd * fixing docs * fixing rgbdPlane * RgbdNormals wrapped * wrap Volume and VolumeParams, VolumeType from enum to int * DepthCleaner wrapped * header folder "rgbd" -> "3d" * fixing header path * VolumeParams referenced by Ptr to support Python wrappers * render...() fixed * Ptr<VolumeParams> fixed * makeVolume(... resolution -> [X, Y, Z]) * fixing static declaration * try to fix ios objc bindings * OdometryFrame::release...() removed * fix for Odometry algos not supporting UMats: prepareFrameCache<>() * preparePyramidMask(): fix to compile with TMat = UMat * fixing debug guards * removing references back; adding makeOdometryFrame() instead * fixing OpenCL ICP hanging (some threads exit before reaching the barrier -> the rest threads hang) * try to fix objc wrapper warnings; rerun builders * VolumeType -> VolumeKind * try to fix OCL bug * prints removed * indentation fixed * headers fixed * license fix * WillowGarage licence notion removed, since it's in OpenCV's COPYRIGHT already * KinFu license notion shortened * debugging code removed * include guards fixed * KinFu license left in contrib module * isValidDepth() moved to private header * indentation fix * indentation fix in src files * RgbdNormals rewritten to pImpl * minor * DepthCleaner removed due to low code quality, no depthScale provided, no depth images found to be successfully filtered; can be replaced by bilateral filtering * minors, indentation * no "private" in public headers * depthTo3d test moved from separate file * Normals: setDepth() is useless, removing it * RgbdPlane => findPlanes() * rescaleDepth(): minor * warpFrame: minor * minor TODO * all Odometries (except base abstract class) rewritten to pImpl * FastICPOdometry now supports maxRotation and maxTranslation * minor * Odometry's children: now checks are done in setters * get rid of protected members in Odometry class * get/set cameraMatrix, transformType, maxRot/Trans, iters, minGradients -> OdometryImpl * cameraMatrix: from double to float * matrix exponentiation: Eigen -> dual quaternions * Odometry evaluation fixed to reuse existing code * "small" macro fixed by undef * pixNorm is calculated on CPU only now (and then uploads on GPU) * test registration: no cvtest classes * test RgbdNormals and findPlanes(): no cvtest classes * test_rgbd.py: minor fix * tests for Odometry: no cvtest classes; UMat tests; logging fixed * more CV_OVERRIDE to overriden functions * fixing nondependent names to dependent * more to prev commit * forgotten fixes: overriden functions, (non)dependent names * FastICPOdometry: fix UMat support when OpenCL is off * try to fix compilation: missing namespaces * Odometry: static const-mimicking functions to internal constants * forgotten change to prev commit * more forgotten fixes * do not expose "submap.hpp" by default * in-class enums: give names, CamelCase, int=>enums; minors * namespaces, underscores, String * std::map is used by pose graph, adding it * compute()'s signature fixed, computeImpl()'s too * RgbdNormals: Mat -> InputArray * depth.hpp: Mat -> InputArray * cameraMatrix: Matx33f -> InputArray + default value + checks * "details" headers are not visible by default * TSDF tests: rearranging checks * cameraMatrix: no (realistic) default value * renderPointsNormals*(): no wrappers for them * debug: assert on empty frame in TSDF tests * debugging code for TSDF GPU * debug from integrate to raycast * no (non-zero) default camera matrix anymore * drop debugging code (does not help) * try to fix TSDF GPU: constant -> global const ptr
153 lines
4.5 KiB
C++
153 lines
4.5 KiB
C++
// This file is part of OpenCV project.
|
|
// It is subject to the license terms in the LICENSE file found in the top-level directory
|
|
// of this distribution and at http://opencv.org/license.html
|
|
|
|
#include "test_precomp.hpp"
|
|
#include <opencv2/3d/detail/pose_graph.hpp>
|
|
|
|
namespace opencv_test { namespace {
|
|
|
|
using namespace cv;
|
|
|
|
static Affine3d readAffine(std::istream& input)
|
|
{
|
|
Vec3d p;
|
|
Vec4d q;
|
|
input >> p[0] >> p[1] >> p[2];
|
|
input >> q[1] >> q[2] >> q[3] >> q[0];
|
|
// Normalize the quaternion to account for precision loss due to
|
|
// serialization.
|
|
return Affine3d(Quatd(q).toRotMat3x3(), p);
|
|
};
|
|
|
|
// Rewritten from Ceres pose graph demo: https://ceres-solver.org/
|
|
static Ptr<detail::PoseGraph> readG2OFile(const std::string& g2oFileName)
|
|
{
|
|
Ptr<detail::PoseGraph> pg = detail::PoseGraph::create();
|
|
|
|
// for debugging purposes
|
|
size_t minId = 0, maxId = 1 << 30;
|
|
|
|
std::ifstream infile(g2oFileName.c_str());
|
|
if (!infile)
|
|
{
|
|
CV_Error(cv::Error::StsError, "failed to open file");
|
|
}
|
|
|
|
while (infile.good())
|
|
{
|
|
std::string data_type;
|
|
// Read whether the type is a node or a constraint
|
|
infile >> data_type;
|
|
if (data_type == "VERTEX_SE3:QUAT")
|
|
{
|
|
size_t id;
|
|
infile >> id;
|
|
Affine3d pose = readAffine(infile);
|
|
|
|
if (id < minId || id >= maxId)
|
|
continue;
|
|
|
|
bool fixed = (id == minId);
|
|
|
|
// Ensure we don't have duplicate poses
|
|
if (pg->isNodeExist(id))
|
|
{
|
|
CV_LOG_INFO(NULL, "duplicated node, id=" << id);
|
|
}
|
|
pg->addNode(id, pose, fixed);
|
|
}
|
|
else if (data_type == "EDGE_SE3:QUAT")
|
|
{
|
|
size_t startId, endId;
|
|
infile >> startId >> endId;
|
|
Affine3d pose = readAffine(infile);
|
|
|
|
Matx66d info;
|
|
for (int i = 0; i < 6 && infile.good(); ++i)
|
|
{
|
|
for (int j = i; j < 6 && infile.good(); ++j)
|
|
{
|
|
infile >> info(i, j);
|
|
if (i != j)
|
|
{
|
|
info(j, i) = info(i, j);
|
|
}
|
|
}
|
|
}
|
|
|
|
if ((startId >= minId && startId < maxId) && (endId >= minId && endId < maxId))
|
|
{
|
|
pg->addEdge(startId, endId, pose, info);
|
|
}
|
|
}
|
|
else
|
|
{
|
|
CV_Error(cv::Error::StsError, "unknown tag");
|
|
}
|
|
|
|
// Clear any trailing whitespace from the line
|
|
infile >> std::ws;
|
|
}
|
|
|
|
return pg;
|
|
}
|
|
|
|
|
|
TEST( PoseGraph, sphereG2O )
|
|
{
|
|
// Test takes 15+ sec in Release mode and 400+ sec in Debug mode
|
|
applyTestTag(CV_TEST_TAG_LONG, CV_TEST_TAG_DEBUG_VERYLONG);
|
|
|
|
// The dataset was taken from here: https://lucacarlone.mit.edu/datasets/
|
|
// Connected paper:
|
|
// L.Carlone, R.Tron, K.Daniilidis, and F.Dellaert.
|
|
// Initialization Techniques for 3D SLAM : a Survey on Rotation Estimation and its Use in Pose Graph Optimization.
|
|
// In IEEE Intl.Conf.on Robotics and Automation(ICRA), pages 4597 - 4604, 2015.
|
|
|
|
std::string filename = cvtest::TS::ptr()->get_data_path() + "/cv/rgbd/sphere_bignoise_vertex3.g2o";
|
|
Ptr<detail::PoseGraph> pg = readG2OFile(filename);
|
|
|
|
#ifdef HAVE_EIGEN
|
|
// You may change logging level to view detailed optimization report
|
|
// For example, set env. variable like this: OPENCV_LOG_LEVEL=INFO
|
|
|
|
int iters = pg->optimize();
|
|
|
|
ASSERT_GE(iters, 0);
|
|
ASSERT_LE(iters, 36); // should converge in 36 iterations
|
|
|
|
double energy = pg->calcEnergy();
|
|
|
|
ASSERT_LE(energy, 1.47723e+06); // should converge to 1.47722e+06 or less
|
|
|
|
// Add the "--test_debug" to arguments to see resulting pose graph nodes positions
|
|
if (cvtest::debugLevel > 0)
|
|
{
|
|
// Write edge-only model of how nodes are located in space
|
|
std::string fname = "pgout.obj";
|
|
std::fstream of(fname, std::fstream::out);
|
|
std::vector<size_t> ids = pg->getNodesIds();
|
|
for (const size_t& id : ids)
|
|
{
|
|
Point3d d = pg->getNodePose(id).translation();
|
|
of << "v " << d.x << " " << d.y << " " << d.z << std::endl;
|
|
}
|
|
|
|
size_t esz = pg->getNumEdges();
|
|
for (size_t i = 0; i < esz; i++)
|
|
{
|
|
size_t sid = pg->getEdgeStart(i), tid = pg->getEdgeEnd(i);
|
|
of << "l " << sid + 1 << " " << tid + 1 << std::endl;
|
|
}
|
|
|
|
of.close();
|
|
}
|
|
#else
|
|
throw SkipTestException("Build with Eigen required for pose graph optimization");
|
|
#endif
|
|
}
|
|
|
|
|
|
}} // namespace
|