1 / 44

Datorseende

Datorseende. TexPoint fonts used in EMF: A A. World model. Computer graphics. World model. Computer vision. What is computer vision?. Image Understanding (AI, behavior) Computer emulation of human vision A sensor modality for robotics Inverse of Computer Graphics.

raiden
Télécharger la présentation

Datorseende

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Datorseende TexPoint fonts used in EMF: AA

  2. World model Computer graphics World model Computer vision What is computer vision? • Image Understanding (AI, behavior) • Computer emulation of human vision • A sensor modality for robotics • Inverse of Computer Graphics

  3. shape estimation • modeling • shape • light • motion • optics • images • IP motion estimation rendering recognition • modeling • shape • light • motion • optics • images • IP surface design 2D modeling animation Computer Vision user-interfaces Computer Graphics Intersection of vision and graphics

  4. Image-based rendering • What is image-based rendering? • The synthesis of new views of a scene from pre-recorded pictures • Why? • Many applications

  5. Example: Panoramic mosaics • + + … + =

  6. Image-based rendering • How? General pipeline:

  7. Image-based rendering • Three approaches: • 3D model construction from image sequences • Transfer-based image synthesis • Light field

  8. Approach 1:3D model construction from image sequences • Techniques that first recover a three dimensional scene model from a sequence of pictures, then render it with classical computer graphics tools • Scene modelling from: • Registered images • Unregistered images

  9. Scene modellingfrom registered images • All images are registered in the same global coordinate system • What kinds of reconstruction? • Volumetric reconstruction • Surface reconstruction • Depth maps • …

  10. Surfaces and their outlines Occluding contour Camera centre Image contour

  11. Surfaces and their outlines Shadow boundary The viewing cone

  12. Volumetric reconstruction • It is impossible to uniquely reconstruct an object from its image contours. Why? • Two main constraints imposed on a solid shape by its image contours: • The shape should lie in the intersection of all viewing cones • The cones should be tangent to its surface • Techniques: • Voxel carving • Polyhedral approximation • Smooth surface fitting

  13. Smooth surfaces from image contours • Example by Ponce: Spline parametrization which minimizes the energy:

  14. Virtualized RealityTM • Capture synchronized video from a full hemisphere of views. • Perform new view generation

  15. Virtualized RealityTM • Spatio-Temporal View InterpolationS. Vedula, S. Baker, and T. KanadeEurographics Workshop on Rendering, June, 2002.

  16. Virtualized RealityTM • Build 3D model and compute 3D scene flow, interpolate view and time.

  17. FILM!

  18. Scene modellingfrom unregistered images • Not necessary to reconstruct all images into one global coordinate system • A priori model of the scene

  19. Image-based modeling

  20. Façade • Select building blocks • Align them in each image • Solve for camera poseand block parameters(using constraints)

  21. View-dependent texture mapping • Determine visible cameras for each surface element • Blend textures (images) depending on distance between original camera and novel viewpoint

  22. FILM!

  23. Model-based reconstruction from one image J-E Solem, F. Kahl, 2005

  24. Approach 2: Transfer-based image synthesis This example is based on computing consistent homographies between all planes (B. Johansson, 2003)

  25. View Morphing • Morph between pair of images using epipolar geometry [Seitz & Dyer, SIGGRAPH’96]

  26. Affine view synthesis • På tavlan!

  27. Approach 3: The light field

  28. What is light? • Electromagnetic radiation (EMR) moving along rays in space • R(l) is EMR, measured in units of power (watts) • l is wavelength • Light field • We can describe all of the light in the scene by specifying the radiation (or “radiance” along all light rays) arriving at every point in space and from every direction

  29. Ray • Constant radiance • time is fixed • 5D • 3D position • 2D direction

  30. Line • Infinite line • 4D • 2D direction • 2D position • non-dispersive medium

  31. Image • What is an image? • All rays through a point • Panorama

  32. Panoramic Mosaics • Convert panoramic image sequence into a cylindrical image • + + … + =

  33. Image • Image plane • 2D • position in plane

  34. Object • Light leaving towards “eye” • 2D • just dual of image

  35. Object • All light leaving object

  36. Object • 4D • 2D position (on surface) • 2D direction

  37. Object • All images

  38. The light field • Summary: • Capture as many images as possible • Store them in a smart way • Discretize rays to synthesize new images

  39. Complex Light Field acquisition • Digital Michelangelo Project • Marc Levoy, Stanford University • Lightfield (“night”) assembled by Jon Shade

  40. Surface Light Fields • [Wood et al, SIGGRAPH 2000]

  41. Sammanfattning • Vysyntes och bildbaserad modellering • Nära relationer till datorgrafik • Tre strategier: • Först 3D modell, sedan använd datorgrafik • Transfer-baserad vysyntes • Light field

More Related