Attention: Answers.ros.org is deprecated as of August the 11th, 2023. Please visit robotics.stackexchange.com to ask a new question. This site will remain online in read-only mode during the transition and into the foreseeable future. Selected questions and answers have been migrated, and redirects have been put in place to direct users to the corresponding questions on Robotics Stack Exchange. Additional details are available here.
rqt_bag and rqt_plot function almost exactly as your proposed solution. Here is a simple tutorial to view bag files and rqt_plot has a similar tutorial.