1 / 33

IBMR Methods and Dimensionality: Exploring Choices of Dimensions for Rendering

This text discusses various dimensions that can be used in the Image-Based Modeling and Rendering (IBMR) process, including camera shape, position, movement, emitted light, reflected and scattered light, and texture. It also explores unconventional mappings and methods in IBMR.

egillum
Télécharger la présentation

IBMR Methods and Dimensionality: Exploring Choices of Dimensions for Rendering

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CS 395/495-25: Spring 2003 IBMR: Week 10A Dimensionality ofIBMR Methods Jack Tumblin jet@cs.northwestern.edu

  2. Reminders • ProjA graded: Good Job! 90,95, 110 • ProjB graded: Good! minor H confusions. • MidTerm graded: novel solutions encouraged. • ProjC due Friday, May 16: graded. • ProjD posted, due Friday May 30 too many unfinished—final is coming! • Take-Home Final Exam: Assign on Thurs June 5, due June 11

  3. Handouts today: • Levoy/Marschner Bibliography • Masselus et. al, 2003: Relighting with 4D incident Light Fields (on the website)

  4. ‘Rendering’ from a camera? Many choices of dimensions for IBMR: Camera Shape, Position, Movement, Emitted Light zc xc yc Reflected, Scattered, Light … BRDF, Texture, Scattering

  5. 1-D? Moving Line-scan Cameras Multiple-Center-of-Projection Images Rademacher, Pl, Bishop, G., SIGGRAPH '98

  6. 1-D? Moving Line-scan Cameras Rademacher, Pl, Bishop, G., Multiple-Center-of-Projection Images SIGGRAPH '98. Rademacher, Pl, Bishop, G., Multiple-Center-of-Projection Images SIGGRAPH '98.

  7. 1-D? Moving Line-scan Cameras Shum, Concentric Image Mosaics SIGGRAPH • Andrew Davidhazy, RIT: http://www.rit.edu/~andpph/

  8. 1-D? Moving Line-scan Cameras ? What other unusual mappings of position vs. 4-D ray direction might help in IBMR? • Example: [Alison Ortony] torus map: --pre-aligned epipolar geometry, --no ‘north/south’ pole problems

  9. 2-D: Image-Space Manipulations • Morphs • Beier92, • Seitz96, • LightField Morphs 2002 ... • deep pixels • PTMs, • Environment Matte...

  10. Impostors/Billboards:

  11. Polynomial Texture Maps Store just 6coefficientsat each pixel, get Interactive re-lighting... A Mostly 2-D Method Malzbender, HPlabs 2001

  12. ‘2.5’-D: Images + a little more... • 2.5D: Depth textures • Billboards/Impostors, LDIs: Multiple pixels along line-of sight... Jonathan Shade, Steven J. Gortler, Li-wei He, Richard Szeliski. SIGGRAPH 98.http://grail.cs.washington.edu/projects/ldi/Generalization: LDI Trees, SIGG99http://www.cs.unc.edu/~ibr/pubs/chang-sg99/abstract.html

  13. ‘2.5’-D: Images + a little more...

  14. 2.5D: Images plus different lighting • Relighting by linear image combos: demohttp://www.sgi.com/grafica/synth/index.html • Non-Physical Combinations: • Negative Light • Generalizations—Malzbender2001 and others, • Debevec: sphere of point sources polarizer separates diffuse, specular terms (simplified BRDF) • Factor images for BRDF samples: McCool, Ramamoorthy

  15. Debevec ‘Light Stage’

  16. Image-Based Actual Re-lighting Light the actress in Los Angeles Debevec et al., SIGG2001 Film the background in Milan, Measure incoming light, Matched LA and Milan lighting. Matte the background

  17. Williams 1998: ‘Inflated Silhouettes’ • http://graphics.stanford.edu/workshops/ibr98/#Schedule%20of%20sessions

  18. Williams 1998: ‘Inflated Silhouettes’ • Symmetric, ‘Natural’ objects • Reliable Silhouette extraction • Implicit Function for Depth: rounded, diffused, relaxation... • Refine with ? texture/shading? • manual ‘paintbox’ for depth? • Simple, quick, fairly good results...

  19. Williams 1998: ‘Inflated Silhouettes’ • http://graphics.stanford.edu/workshops/ibr98/#Schedule%20of%20sessions Not bad! Can we do better?

  20. 3-D Methods • Fans, silhouettes: • Ramesh Raskar and Michael Cohen. Image Precision Silhouette Edges. I3D 99. • Voxel Carving(Seitz, others) Seitz,1998

  21. 3D: Try image + other dimensions • Halle: Multiple Viewpoint Rendering (SIGG98)http://web.media.mit.edu/~halazar/sig98/halle98.pdf

  22. Oh et. al, 2001: 2D3D • 3D ‘Power tools’ for editing 2D imageshttp://graphics.lcs.mit.edu/ibedit/ibedit_s2001_cameraReady.pdf

  23. 4-D Methods Incoming Rays: 4D Outgoing Rays: 4D • Light fields • Illum Fields • Shape/Light field refinement

  24. 4D Methods Light-source Light Fields Accurate Light Source Acquisition and Rendering M. Goesele, X. Granier, W. Heidrich, H.-P. Seidel, SIGG2003

  25. Image-Based Synthetic Re-lighting Masselus et al., 2002

  26. Illuminant direction estimation Take pictures and move hand-held light source Basis images · W1 + · W2 + · Wn + … Create weighted sum Relit object Incident light map Masselus et al., 2002, “Free-Form Light Stage”

  27. Image-Based Shape Approximation Matusik 2002

  28. Image-Based Shape Approximation Matusik 2002 Matusik 2002

  29. Image-Based Shape Refinement Fine geometric Details  Fine Texture/Normal Details Rushmeier, 2001

  30. 5-D Methods and beyond... surface light fields,(Chen et al, SIGG02) Synthetic+ real

  31. 5-D Methods and beyond... Relighting with 4D Incident Light Fields Vincent Masselus, Pieter Peers, Philip Dutre and Yves D. Willems SIGG2003

  32. Interreflections? Rushmeier, 1996

  33. END

More Related