| ROS Resources: Documentation | Support | Discussion Forum | Index | Service Status | ros @ Robotics Stack Exchange |
Looking for recommendations for ROS nodes or C++ libraries that can take multiple independent camera image streams and combine them into a single 360 deg image stream. I’m looking for something that handles stitching the images together rather than just overlaying them based on the URDF file. Any recommendations?
For the case of static and known camera calibration, we've created a package called virtual_camera that stitches a spherical panorama from a configurable number of input cameras (we use 5 horizontal cams and 1 ceiling-looking). It hasn't been properly published anywhere, but you can access its docs and code from http://cmp.felk.cvut.cz/nifti/sw/virt... . The code in there is a little old, I think it was last tested on Groovy or so, but it shouldn't be that difficult to get it running on modern ROS1 distros. We have an unpublished version for Melodic - if you were interested, PM me on ROS discourse (peci1).
Example input (all cameras stitched next to each other for the visualization, but normally it's 6 distinct images):
Example output:
Thanks @peci1 ! This is exactly the kind of thing I am looking for. I will message you on discourse and I'll probably mark this as the answer, but I'll give some more time for others to respond if there is additional tooling out there.
I came here looking for the same thing. Can I get the source code?
We're now in the process of rationalizing our codebase and open-sourcing as much as possible. The virtual camera package should be released in a month or two. In the meantime, have a look at https://github.com/tu-darmstadt-ros-p... (maybe we'll merge our implementation with this one if we find the two close enough).
Hi @peci1 will appreciate if you share when it's released!
I'm new to all these and doing them as a hobby, but what started from an idle search about how 360 cameras work turned into a fascination on how complex all these stuff are from taking pictures to stitching them to turning them into 360 pictures (still not sure if 360 refers to spherical or not). Grappling with a lot of new concepts to me from the lens all the way to the software, so this will be very interesting to me as well. Thanks in advance!
Asked: 2020-11-05 09:29:53 -0600
Seen: 1,478 times
Last updated: Nov 09 '20
ROS Answers is licensed under Creative Commons Attribution 3.0 Content on this site is licensed under a Creative Commons Attribution Share Alike 3.0 license.
Is the calibration between the cameras known and static? Or do you need to also do some feature matching and pose optimization before the stitching?
You can also give a try to panotools, but I've never used it for anything else than stitching panoramas from my outdoor trips... However, it's opensource, high quality, and it should have all the features you might need.
camera positions are static relative to each other but the system is on a moving base.