6DOF Localization with stereo camera against RGBD dense point cloud

asked 2016-11-02 01:23:47 -0600

natejgardner
36 ●7 ●8 ●9

I have a point cloud of an environment generated by a Kinect One using rtabmap. I have a stereo camera, and I'm looking for a ROS package capable of performing full 6DOF localization using the stereo camera against this existing point cloud. Although I have found many solutions for stereo SLAM, I am having a hard time finding anything for localization-only using the stereo camera. What I have found seems to only be depth-based. I'm looking for something that could perform this localization based on the full RGBD cloud, and is compatible with Kinetic. Are there any packages that do this? I would like to produce a pose estimate primarily based on the stereo camera, augmented by IMUs and IR rangefinders, and other monocular cameras. Presumably, once I have a stereo localization, I could pass the other sensors through the robot_localization package to get a fused posed estimate. Any suggestions for a stereo localization package?

answered 2016-11-02 12:51:14 -0600

matlabbe

6409 ●11 ●96 ●80

Since you mentionned rtabmap, I'll describe what you can already do with it. rtabmap can do stereo localization in a map created previously by rtabmap (with any other sensors, stereo or rgb-d):

$ roslaunch rtabmap_ros stereo_mapping.launch database_path:="~/map_created_with_kinect.db" localization:=true

See stereo_mapping.launch for other remapping options (image topics or frame_id.). You can also see this tutorial on stereo mapping with rtabmap.

rtabmap will not do stereo/rgbd localization on an arbitrary raw point cloud, only with its database format.

cheers

edit flag offensive delete link

Comments

This solution is only localization based on loop closure images, right? It is not localizing against any point cloud or 3D data, but only against the loop closure images and their vectors, right?

natejgardner ( 2016-11-02 21:16:51 -0600 )edit

Yes this is against the loop closure images. When a matching image is found, the 6DOF pose of the camera is computed against it (using the 3D keypoints and/or laser scans), so it is localized in the map.

matlabbe ( 2016-11-03 08:43:30 -0600 )edit

add a comment

6DOF Localization with stereo camera against RGBD dense point cloud

1 Answer

Comments

Question Tools

Stats

Related questions

6DOF Localization with stereo camera against RGBD dense point cloud edit

1 Answer

Comments

Question Tools

Stats

Related questions

6DOF Localization with stereo camera against RGBD dense point cloud