Style/Content separation - PowerPoint PPT Presentation

slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Style/Content separation PowerPoint Presentation
Download Presentation
Style/Content separation

play fullscreen
1 / 98
Style/Content separation
206 Views
Download Presentation
lexine
Download Presentation

Style/Content separation

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. Style/Content separation Evgeniy Bart, Dan Levi April 13, 2003

  2. Artistic styles Photograph

  3. Artistic styles Impressionist

  4. Artistic styles Expressionist

  5. Artistic styles Pointillist

  6. Photographic styles *Pictures by Aya Aner-Wolf

  7. Content Style Fonts

  8. Faces *Images from FERET database

  9. Tasks Extrapolation: • Extrapolation of familiar style to new content

  10. Tasks Extrapolation: • Extrapolation of familiar content to new style

  11. Tasks Translation:

  12. Task specification by analogy : : ? Image analogies, Hertzmann et al.

  13. Wei&Levoy Ashikhmin

  14. Region growing Somewhat similar to quilting *Picture from presentation by Tal and Zeev

  15. Region growing

  16. Combining the two … : :

  17. … hierarchically : :

  18. … hierarchically : :

  19. … hierarchically : :

  20. Selecting best match

  21. Arbitrating yes no ? Use Ashikhmin value Use Wei&Levoy value

  22. Arbitrating yes no ? Use Ashikhmin value Use Wei&Levoy value

  23. Arbitrating yes no ? Use Ashikhmin value Use Wei&Levoy value

  24. Results – artistic filters : :

  25. Results – artistic filters : :

  26. Results – artistic filters : :

  27. Super-resolution Training 1 :

  28. Super-resolution Training 2 :

  29. Super-resolution Training 3 :

  30. Super-resolution Results :

  31. Super-resolution Results :

  32. A lonely pine is standing In the North where high winds blow. He sleeps; and the whitest blanket wraps him in ice and snow. He dreams - dreams of a palm-tree that far in an Orient land Languishes, lonely and drooping, Upon the burning sand. H. Heine, translated by L. Untermeyer

  33. Texture by numbers : :

  34. Parameters annEpsilon: [float] = 1.000000 ashLastLevel: [bool] = false biasPenalty: [float] = 0.000000 cheesyBoundaries: [bool] = true coherenceEps: [float] = 5.000000 coherencePow: [float] = 2.000000 createSrcLocHisto: [bool] = false decayWeight: [double] = 0.000000 filterColorspace: [enum] = {Lab, Luv, RGB, XYZ} filterMM: [string] = (none!) filterModeMask: [string] = (none!) filterProcedure: [enum] = {Copy, Synthesize} filteredFeatureType: [enum] = {Difference, Raw} filteredPyramidType: [enum] = {Gaussian, Laplacian} finalSourceFac: [float] = -1.000000 gainPenalty: [float] = 0.000000 heurAnnEpsilon: [float] = 1.000000 heurMaxTSVQDepth [int] = 7 histogramEq: [bool] = false levelWeighting: [float] = 1.000000 matchBtoA: [bool] = false matchGrayHistogram: [bool] = false matchMeanVariance: [bool] = false maxTSVQDepth: [int] = 20 maxTSVQError: [float] = 0.000000 modeMaskWeight: [float] = 0.010000 neighborhoodWidth: [int] = 5 pyramidType: [enum] = {Gaussian, Laplacian, Steerable} samplerEpsilon: [float] = 0.100000 searchMethod: [enum] = {ANN, Ash, HeurANN, HeurTSVQ, Image, MLP, TSVQ, TSVQR, Vector} sourceColorspace: [enum] = {Lab, Luv, RGB, XYZ} srcWeight: [float] = 1.000000 targetMM: [string] = (none!) targetModeMask: [string] = (none!) useBias: [bool] = false useFilter: [bool] = true useFilterModeMask: [bool] = false useGain: [bool] = false useInterface: [bool] = true useRandomStart: [bool] = true useSigmoidalDecay: [bool] = false useSplineWeights: [bool] = true useTargetModeMask: [bool] = false useYIQ: [bool] = false numHiddenNeurons: [int] = 20 numLevels: [int] = 2 numPasses: [int] = 1 numTSVQBacktracks: [int] = 8 onePixelSource: [bool] = false oneway: [bool] = false pyramidHeight: [int] = 4

  35. 3D rotation : :

  36. 3D rotation : :

  37. 3D rotation : :

  38. 3D rotation : :

  39. 3D rotation : :

  40. What went wrong? There is some structure, but not simple correspondence Need more knowledge about objects

  41. Rectangular parallelepipeds (cuboids)

  42. Representation by 3D point coordinates Linear classes, Vetter&Poggio

  43. May combine linearly + = = +

  44. Only 3 dimensions + + = = Call it linear class

  45. Linear operators • Linear operator L

  46. Example: rotation + + = =

  47. Rotation If Then

  48. Example: projection + + = =

  49. Projection If Then

  50. Example: projection + rotation + + = =