270 likes | 401 Vues
Explore the latest advancements in image and video editing from MS Research Cambridge (MSRC), focusing on areas such as airbrushing history, video segmentation, object recognition, and real-time object recognition. Learn about technologies like PatchWorks, Clone, and Resynthesizer that enable efficient editing of visual content. Discover how machine learning is revolutionizing object recognition and visual search challenges.
E N D
MSR Cambridge Vision Group • Editing Images • Editing videos • Live video • Recognising objects • Remote collaboration
Images and videos as first-class objects MS Research Cambridge (MSRC) -- Machine Learning and Perception Group
Patchworks • Inpainting: smooth completion over small gaps, but slow • PatchWork: similar (a bit less smooth) to Inpainting, but fast... PatchWorks Inpainting
Filling in large Holes • Inpainting: does not work • Resynthesizer (Gimp): 2’45’’ (computation) • Clone (PictureIt): 5’ (hand-labor) • PatchWork: 10’’ (computation) Clone Resynthesizer PatchWorks
Demo: • Patchworks/Grabcut
From still images ... to video • Research challenge: analysing movement • Reacting to people • Making personal video manageable
Why is visual search hard? What the computer sees What you see
Cartoon collection -- Daimler-Benz ++
Tracking motion with a cartoon “flip-book” • Application of (award winning) MSRC work on visual tracking
Stereo webcam conventional camera - zoomed out conventional camera - zoomed in Smart Framing - start Smart Framing - continue
i2i project Prize-winning technology
General object class recognition Learned visual dictionary - underlies image/video search - object sensitive image editing Machine Learning: Object recognition
Image segmentation applications to colonoscopy joint project (TCI) with U. Oxford Stereo imaging surgical visualisation, Papworth hospital Video tracking - echocardiographic analysis - joint PhD (ESI) with U. Oxford People: Andrew Blake, Antonio Criminisi, Carsten Rother, Victor Lempitsky. Medical Imaging Interests at MSRC
Summary: MSRC Vision/Graphics • Images and videos: first-class citizens of the desktop • Image processing accessible for all users • Video: communication, remote collaboration, medicine • Research feeding into video and graphics products