Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Cheng, Ming-Ming; Zhang, Fang-Lue; Mitra, Niloy J.; Huang, Xiaolei; Hu, Shi-Min (2010)
Publisher: ACM
Languages: English
Types: Article
Subjects: QA76, T1

Classified by OpenAIRE into

Repeated elements are ubiquitous and abundant in both manmade and natural scenes. Editing such images while preserving the repetitions and their relations is nontrivial due to overlap, missing parts, deformation across instances, illumination variation, etc. Manually enforcing such relations is laborious and error-prone. We propose a novel framework where user scribbles are used to guide detection and extraction of such repeated elements. Our detection process, which is based on a novel boundary band method, robustly extracts the repetitions along with their deformations. The algorithm only considers the shape of the elements, and ignores similarity based on color, texture, etc. We then use topological sorting to establish a partial depth ordering of overlapping repeated instances. Missing parts on occluded instances are completed using information from other instances. The extracted repeated instances can then be seamlessly edited and manipulated for a variety of high level tasks that are otherwise difficult to perform. We demonstrate the versatility of our framework on a large set of inputs of varying complexity, showing applications to image rearrangement, edit transfer, deformation propagation, and instance replacement.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • ADAMS, A., GELFAND, N., DOLSON, J., AND LEVOY, M. 2009. Gaussian KD-trees for fast high-dimensional filtering. ACM Trans. Graph. 28, 3, 21:1-12.
    • AHUJA, N., AND TODOROVIC, S. 2007. Extracting texels in 2.1D natural textures. In Proc. of ICCV, 1-8.
    • AN, X., AND PELLACINI, F. 2008. Appprop: all-pairs appearancespace edit propagation. ACM Trans. Graph. 27, 3, 40: 1-9.
    • BAI, X., LI, Q. N., LATECKI, L. J., LIU, W. Y., AND TU, Z. W. 2009. Shape band: A deformable object detection approach. In Proc. of CVPR, 1335-1342.
    • BAI, X., WANG, J., SIMONS, D., AND SAPIRO, G. 2009. Video SnapCut: robust video object cutout using localized classifiers. In ACM Trans. Graph., ACM, 70.
    • BARNES, C., SHECHTMAN, E., FINKELSTEIN, A., AND GOLDMAN, D. B. 2009. Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28, 3, 24:1-11.
    • BAY, H., ESS, A., TUYTELAARS, T., AND GOOL, L. J. V. 2008. Speeded-up robust features (SURF). Computer Vision and Image Understanding 110, 3, 346-359.
    • BELONGIE, S., MALIK, J., AND PUZICHA, J. 2002. Shape matching and object recognition using shape contexts. IEEE TPAMI 24, 4, 509-522.
    • BERG, A. C., BERG, T. L., AND MALIK, J. 2005. Shape matching and object recognition using low distortion correspondences. In Proc. of CVPR, I: 26-33.
    • BOOKSTEIN, F. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE TPAMI 11, 6, 567-585.
    • BOYKOV, Y. Y., AND LEA, G. F. 2006. Graph cuts and efficient N-D image segmentation. IJCV 70, 2, 109-131.
    • BROX, T., KLEINSCHMIDT, O., AND CREMERS, D. 2008. Efficient nonlocal means for denoising of textural patterns. IEEE Trans. Image Processing 17, 7, 1083-1092.
    • CHEN, T., CHENG, M., TAN, P., SHAMIR, A., AND HU, S. 2009. Sketch2Photo: internet image montage. ACM Trans. Graph. 28, 5, 124: 1-10.
    • CHO, T. S., BUTMAN, M., AVIDAN, S., AND FREEMAN, W. T. 2008. The patch transform and its applications to image editing. In Proc. of CVPR, 1-8.
    • CRIMINISI, A., PEREZ, P., AND TOYAMA, K. 2004. Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Processing 13, 9, 1200-1212.
    • EISEMANN, E., AND DURAND, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23, 3, 673-678.
    • HO, J., PETER, A., RANGARAJAN, A., AND YANG, M.-H. 2009. An algebraic approach to affine registration of point sets. In Proc. of ICCV, 1-8.
    • HOIEM, D., EFROS, A. A., AND HEBERT, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577-584.
    • IGARASHI, T., MOSCOVICH, T., AND HUGHES, J. F. 2005. Asrigid-as-possible shape manipulation. ACM Trans. Graph. 24, 3, 1134-1141.
    • JIA, Y., HU, S., AND MARTIN, R. 2005. Video completion using tracking and fragment merging. The Visual Computer 21, 8, 601- 610.
    • KARNI, Z., FREEDMAN, D., AND GOTSMAN, C. 2009. Energybased image deformation. Comput. Graph. Forum 28, 5, 1257- 1268.
    • KILTHAU, S. L., DREW, M. S., AND MOLLER, T. 2002. Full search content independent block matching based on the fast fourier transform. In Proc. of ICIP, I: 669-672.
    • KOFFKA, K. 1935. Principles of Gestalt Psychology. Lund Humphries.
    • LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. IJCV 60, 2, 91-110.
    • PARIS, S., AND DURAND, F. 2007. A topological approach to hierarchical segmentation using mean shift. In Proc. of CVPR, 1-8.
    • PAULY, M., MITRA, N. J., WALLNER, J., POTTMANN, H., AND GUIBAS, L. J. 2008. Discovering structural regularity in 3D geometry. ACM Trans. Graph. 27, 3, 43:1-11.
    • ROTHER, C., KOLMOGOROV, V., AND BLAKE, A. 2004. GrabCut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23, 3, 309-314.
    • SAPIRO, G., KIMMEL, R., AND CASELLES, V. 1995. Geodesic active contours. In Proc. of ICCV, 694-699.
    • SCHAEFER, S., MCPHAIL, T., AND WARREN, J. 2006. Image deformation using moving least squares. ACM Trans. Graph. 25, 3, 533-540.
    • SHAMIR, A., AND AVIDAN, S. 2009. Seam carving for media retargeting. Commun. ACM 52, 1, 77-85.
    • SHI, J., AND MALIK, J. 2000. Normalized cuts and image segmentation. IEEE TPAMI 22, 8, 888-905.
    • SIMAKOV, D., CASPI, Y., SHECHTMAN, E., AND IRANI, M. 2008. Summarizing visual data using bidirectional similarity. In Proc. of CVPR, 1-8.
    • SUN, J., YUAN, L., JIA, J., AND SHUM, H.-Y. 2005. Image completion with structure propagation. ACM Trans. Graph. 24, 3, 861-868.
    • THAYANANTHAN, A., STENGER, B., TORR, P. H. S., AND CIPOLLA, R. 2003. Shape context and chamfer matching in cluttered scenes. In Proc. of CVPR, I: 127-133.
    • XU, K., LI, Y., JU, T., HU, S., AND LIU, T. 2009. Efficient affinity-based edit propagation using KD tree. In ACM Trans. Graph., ACM, 118: 1-6.
    • ZHANG, G.-X., CHENG, M.-M., HU, S.-M., AND MARTIN, R. R. 2009. A shape-preserving approach to image resizing. Comput. Graph. Forum 28, 7, 1897-1906.
    • ZHENG, Q., SHARF, A., WAN, G., LI, Y., MITRA, N. J., COHENOR, D., AND CHEN, B. 2010. Non-local scan consolidation for 3d urban scene. ACM Trans. Graph. 29, 3, to appear.
  • No related research data.
  • No similar publications.

Share - Bookmark

Cite this article