Image Quilting and Apples

1. Image Quilting and Apples By Zach Broderick A presentation of the paper “Image Quilting for Texture Synthesis and Transfer” by Alexei A. Efros and William T. Freeman

2. Texture Synthesis (Images taken from paper)

3. Infinitely Large Output Sample of Texture • Output texture is: • Same resolution • Non-repeating • Seamless • Must be perceived as “same”

4. Previous Methods • Tiling (bad seams, repetitive) • Stochastic (doesn’t work for structured) • Pixel-based (SLOW, poor for structured) • Random Patches/Blending (poor seams)

5. Image Quilting • Copy patches (like the random patch method) based on neighborhood (like pixel method) • Faster (predetermined pixels/less search space), maintains structure of regular textures • Seams smoothed with graph cut through least error path (Image from Wikipedia)

6. Image Quilting (Diagram from paper)

7. An In-Depth Look at the Image Quilting Algorithm: Overview • Copy tiles from the source image to the destination image in a left to right, top to bottom fashion, with an overlap of about 1/6 the tile size on the top and left regions. • In selecting each of these tiles, search the source image space S for the tile with the least mean squared error in the overlap region (the first tile can be selected at random). • When copying each tile, calculate the minimum error path cut in each of the overlap regions, and only copy the portion of the tile within the cut.

9. Error Calculation

10. Path Cut

11. Path Cut Cont’d…

12. Texture Transfer • Algorithm can be generalized to provide texture transfer capabilities (image from paper)

13. Problems • Repetition often occurs (see raspberries) • Occasional glaring seams (mutant tomatoes)

14. Demonstration

15. Questions?