Style/Content separation

1. Style/Content separation Evgeniy Bart, Dan Levi April 13, 2003

2. Artistic styles Photograph

3. Artistic styles Impressionist

4. Artistic styles Expressionist

5. Artistic styles Pointillist

6. Photographic styles *Pictures by Aya Aner-Wolf

7. Content Style Fonts

8. Faces *Images from FERET database

9. Tasks Extrapolation: • Extrapolation of familiar style to new content

10. Tasks Extrapolation: • Extrapolation of familiar content to new style

11. Tasks Translation:

12. Task specification by analogy : : ? Image analogies, Hertzmann et al.

13. Wei&Levoy Ashikhmin

14. Region growing Somewhat similar to quilting *Picture from presentation by Tal and Zeev

15. Region growing

16. Combining the two … : :

17. … hierarchically : :

18. … hierarchically : :

19. … hierarchically : :

20. Selecting best match

21. Arbitrating yes no ? Use Ashikhmin value Use Wei&Levoy value

22. Arbitrating yes no ? Use Ashikhmin value Use Wei&Levoy value

23. Arbitrating yes no ? Use Ashikhmin value Use Wei&Levoy value

24. Results – artistic filters : :

25. Results – artistic filters : :

26. Results – artistic filters : :

27. Super-resolution Training 1 :

28. Super-resolution Training 2 :

29. Super-resolution Training 3 :

30. Super-resolution Results :

31. Super-resolution Results :

32. A lonely pine is standing In the North where high winds blow. He sleeps; and the whitest blanket wraps him in ice and snow. He dreams - dreams of a palm-tree that far in an Orient land Languishes, lonely and drooping, Upon the burning sand. H. Heine, translated by L. Untermeyer

33. Texture by numbers : :

34. Parameters annEpsilon: [float] = 1.000000 ashLastLevel: [bool] = false biasPenalty: [float] = 0.000000 cheesyBoundaries: [bool] = true coherenceEps: [float] = 5.000000 coherencePow: [float] = 2.000000 createSrcLocHisto: [bool] = false decayWeight: [double] = 0.000000 filterColorspace: [enum] = {Lab, Luv, RGB, XYZ} filterMM: [string] = (none!) filterModeMask: [string] = (none!) filterProcedure: [enum] = {Copy, Synthesize} filteredFeatureType: [enum] = {Difference, Raw} filteredPyramidType: [enum] = {Gaussian, Laplacian} finalSourceFac: [float] = -1.000000 gainPenalty: [float] = 0.000000 heurAnnEpsilon: [float] = 1.000000 heurMaxTSVQDepth [int] = 7 histogramEq: [bool] = false levelWeighting: [float] = 1.000000 matchBtoA: [bool] = false matchGrayHistogram: [bool] = false matchMeanVariance: [bool] = false maxTSVQDepth: [int] = 20 maxTSVQError: [float] = 0.000000 modeMaskWeight: [float] = 0.010000 neighborhoodWidth: [int] = 5 pyramidType: [enum] = {Gaussian, Laplacian, Steerable} samplerEpsilon: [float] = 0.100000 searchMethod: [enum] = {ANN, Ash, HeurANN, HeurTSVQ, Image, MLP, TSVQ, TSVQR, Vector} sourceColorspace: [enum] = {Lab, Luv, RGB, XYZ} srcWeight: [float] = 1.000000 targetMM: [string] = (none!) targetModeMask: [string] = (none!) useBias: [bool] = false useFilter: [bool] = true useFilterModeMask: [bool] = false useGain: [bool] = false useInterface: [bool] = true useRandomStart: [bool] = true useSigmoidalDecay: [bool] = false useSplineWeights: [bool] = true useTargetModeMask: [bool] = false useYIQ: [bool] = false numHiddenNeurons: [int] = 20 numLevels: [int] = 2 numPasses: [int] = 1 numTSVQBacktracks: [int] = 8 onePixelSource: [bool] = false oneway: [bool] = false pyramidHeight: [int] = 4

35. 3D rotation : :

36. 3D rotation : :

37. 3D rotation : :

38. 3D rotation : :

39. 3D rotation : :

40. What went wrong? There is some structure, but not simple correspondence Need more knowledge about objects

41. Rectangular parallelepipeds (cuboids)

42. Representation by 3D point coordinates Linear classes, Vetter&Poggio

43. May combine linearly + = = +

44. Only 3 dimensions + + = = Call it linear class

45. Linear operators • Linear operator L

46. Example: rotation + + = =

47. Rotation If Then

48. Example: projection + + = =

49. Projection If Then

50. Example: projection + rotation + + = =