Multi-Cam Video Stitching
Multi-Cam Video Stitching. Panoramic Video Option During a Skype Call. Goal. Integrate a panoramic video feature into Multicam Feature takes the inputs of multiple webcams and stitches them together Output is produced in real time Works using hardware of the average user. Applications.
Multi-Cam Video Stitching
E N D
Presentation Transcript
Multi-Cam Video Stitching Panoramic Video Option During a Skype Call
Goal • Integrate a panoramic video feature into Multicam • Feature takes the inputs of multiple webcams and stitches them together • Output is produced in real time • Works using hardware of the average user
Applications • Conference calls • Absentee lecture
Background: Image Stitching • Homography • Computer Vision by R. Szeliski • Types of algorithms • Improving the image
Background: Video Stitching • Efficient stitching made use of GPU • Good quality videos not real time • Good quality but required user input
Our Approach and Research Question • OpenCV • Basic hardware components • Can a good panoramic video be stitched in real time during a Skype call with the equipment of the average person? • “good” • “real time” • “equipment of the average user”
Progress: Preliminary work with OpenCV • Install OpenCV on Mac • Simple image stitch
Progress: Simple Videos • Still camera videos • 640 x 480 resolution • Compute homography for each frame • Compute homography once • Results • Typical video has 24 FPS • Approach #1: .89 FPS • Approach #2: 2.12 FPS
Future Work: Speed • Create a mask of videos, only quarter-sized, calculate the homographies and then scale the homographies up to match real size. • Modify variables included within the Stitcher class. • Allow user to select position on slidebar to adjust precision and performance.
Future Work: Quality • Exposure, Gain • Use built in methods in the stitcher class • Observe effects on time • Try videos in different light, observe effects of built in methods