370 likes | 498 Vues
This paper explores the integration of geometry and appearance in binary shading, presenting a variational rendering model for depicting scenes using limited color palettes. The authors discuss methods for enhancing geometric features through graph-based energy approaches, including results from various shading components like diffuse and specular effects. The framework accommodates both global and local feature control, making it suitable for interactive applications. Experiments demonstrate its effectiveness in generating images that exhibit a range of styles while maintaining a coherent visual representation.
E N D
BinaryShadingusingGeometry and Appearance Bert BuchholzTamyBoubekeur Doug DeCarlo Marc Alexa Telecom ParisTech – CNRS RutgersUniversity TU Berlin Computer Graphics Forum Vol. 29, N. 6, 2010 PresentedatEurographics 2011
BinaryDrawing Depictingscenesusing 2 colors
BinaryRendering Geometry Camera 3D Scene Conversion Reflectance Lighting
RelatedWork Half-Toning [Floyd and Steinberg 1976] [Ostromoukhov and Hersch 1995] • Image Binarization • [Mould and Kaplan 2008] • Local shadingoperators • [Vergne 2008] • Line Drawing • [DeCarlo 2003][Judd 2007]
Analysis Per-pixel decision Contradictory criteria Geometry enhancement Low shading depiction power • Variational Rendering Model
VariationalBinaryShading • Deferred shading framework • Rendering data structured as a ST image graph • Edges energies derived from geometry and appearance • Final rendering as a min cut in the image graph
DeferredShading Generate a set of arrays (render buffers) • GeometricProperties • AppearanceProperties Rasterization Ray Tracing
Graph construction Standard Source-to-Sink Image Graph {V,E} Image Pixels Source (white) Sink (black) Image Connectivity Edges to Source Edges to SInk
Appearance Contribution to the Graph • Through terminal weights on • AppearanceinitiateB/W segmentation • Experimentsusing : • Diffuse component • Specular component • Headlight component • Ambient Occlusion/Accessibilitycomponent Terminal Weights
Appearance Graph Terms Global to local feature control using spatial averages Support size Local term: Sign:locallylighter or darker Weightedcombination to the global measure.
Global versus Local Thresholding Global Local
Geometry Contribution to the Graph • Modelledwithneighboredgeweights • Tailorsanisotropic, non-local B/W diffusion • Redistributes B/W values to enhancegeometricfeatures • Based on: • Viewdepth values • Viewdependentcurvature, estimated as screenspace normal derivatives [Judd 2007] Unit surface normal gatheredat Geodesic distance on the Gauss sphere
GeometricTerm Local curvaturenormalization: Support size Yieldsneighbor edgeweights:
Geometry Contribution Modulation Small components are successively connected
Graph Minimum Cut • Max Flow Min Cut Theorem • Shortest split path in the graph →Feature size control through graph energy • Separate the graph in two components • Boykov and Kolmogorov implementation [2004]
Cut performance • Rendering buffers canbe speed up usingrasterization • Measured on a Core2Duo 1.83GHz (single thread)
BinaryShading • Global to local features • Appearance & geometry depiction • Large variety of style • Interactive control
Comparison to Line Drawing BinaryShading Line Drawing
Combinationwith Line Drawing RGBN Picture Rendering [Toler-Franklin 2007]
Comparison to Thresholding Binary Rendering Diffuse Component Thresholding Thresholding Over Gaussian Filtering
Comparison to Image Binarization (b,e) equivalent to [Mould and Kaplan 2008]
On-goingwork Interactive control
Interactive Control • Solution 1: slider-based, for experts • Accurate control • « Toomuch » control for novice users • Solution 2: painting interface
Paint Interface • Supervised sparse B/W contraints • Derive the graph energy structure
Animation Works most of the time but… … most of straightforward solutions have some temporal coherencyfailure cases.
K-colorRendering • Extend to multi-label cuts • Alternative energy minimizer • Lloyd relaxation/k-means • Mean Shift • k-Component cut • Vector Rendering
BinaryShading as a Single Cut • Global solution • Local to global control • Appearance vs geometry control • High level control • For automaticbinarydrawingfrom 3D Scenes, decals, cut-out, etc…
Thankyou BinaryShadingUsingGeometry and Appearance. Bert Buchholz, TamyBoubekeur, Doug DeCarlo and Marc Alexa Computer Graphics Forum Vol. 29, Nb. 6, 2010 PresentedatEurographics 2011