LAPLACIAN PYRAMID BASED HIERARCHICAL IMAGE INPAINTING

Authors

  • S Padmavathi Department of Information Technology, Amrita School of Engineering, Amrita University, Ettimadai, Coimbatore - 641105 TamilNadu
  • K. P. Soman Department of Information Technology, Amrita School of Engineering, Amrita University, Ettimadai, Coimbatore - 641105 TamilNadu

DOI:

https://doi.org/10.14738/aivp.21.46

Keywords:

Hierarchical Digital Image Inpainting, Laplacian Pyramid, Exemplar based Inpainting, Multiresolution Inpainting,

Abstract

There are many real world scenarios where a portion of the image is damaged or lost. Restoring such an image
without prior knowledge or a reference image is a difficult task. Image inpainting is a method that focuses on reconstructing the damaged or missing portion of images based on the information available from undamaged areas of the same image. The existing methods fill the missing area from the boundary. Their performance varies while reconstructing the structure and texture present in the image and majorly fails for larger inpainting area. This paper attempts to segregate the structure and texture using Laplacian Pyramid and inpaint them separately using a top down approach. The images are inpainted from the
lowest spatial resolution using Exemplar based image synthesis. The results are updated before moving to the higher resolution levels. This multi resolution process ensures the coarser details being filled before the finer details. The structure propagation is better since it is handled separately. The top down approach alleviates the traditional boundary based filling and breaks the single large sized inpainting region into many smaller sized ones as we move down the pyramid. Different types of images have been experimented and the results are summarized.

References

P.J. BURT, E. H. ADELSON.,"The Laplacian Pyramid as a Compact Image Code"., IEEE Trans on Communication,vol. COM-31, no. 4, April 1983

P. PERONA AND J. MALIK, Scale-Space Edge Detection Using Anisotropic Diffusion, IEEE Transactions on Pattern Analysis and

Machine Intelligence, Vol. 12, No.7, July 1990, http://www.cs.berkeley.edu/~malik/papers/MP-aniso.pdf

D.J. HEEGER AND J.R. BERGEN, Pyramid-Based Texture Analysis/Synthesis, Proceedings of SIGGRAPH 1995, pp 229-238, September

http://www.cns.nyu.edu/~david/ftp/reprints/heeger-siggraph95.pdf

A.C. KOKARAM, R.D. MORRIS, W.J. FITZGERALD AND P.J.W. RAYNER, “Interpolation of Missing Data in Image Sequences”,IEEE

Transactions on Image Processing. Vol. 4. No.11, Nov. 1995, pp 1509-1519. URL: http://www.robinmorris.org/sigproc/interpolation.pdf

H. IGEHY AND L. PEREIRA, “Image Replacement through Texture Synthesis”,Proceedings of the IEEE International Conference on

Image Processing, October 1997.URL: http://graphics.stanford.edu/papers/texture_replace/texture_replace.pdf

J.S. DE BONET, “Multi resolution sampling procedure for analysis and synthesis of texture images”, in Proc. ACM Conference Computer

Graphics (SIGGRAPH), volume 31, pages 361–368, 1997.

V. CASELLES, J. M. MOREL, AND C. SBERT, "An Axiomatic Approach to Image Interpolation", IEEE Transactions on Image

Processing, 7, Issue 3, Mar 1998, Page(s): 376 - 386.

M. TUCERYAN AND A. K. JAIN, “Texture Analysis,” Handbook of Pattern Recognition and Computer Vision, C. H. Chan, L. F. Pau, and

P. S. P. Wang (Eds.), Ch.2, pp. 235-276, Singapore: World Scientific, 1998.

A. EFROS AND T. LEUNG. Texture synthesis by non-parametric sampling.In Proc. Int. Conf. Computer Vision, pages 1033–1038,

Kerkyra, Greece, September 1999.

M. BERTALMIO, G. SAPIRO, V. CASELLES, AND C. BALLESTER, "Image Inpainting" Proceedings of the ACM SIGGRAPH

Conference on Computer Graphics, SIGGRAPH2000, New Orleans, USA. July 2000, pp 417-424. URL:

http://www.iua.upf.es/~mbertalmio/bertalmi.pdf

M. BERTALMIO, A.L. BERTOZZI AND G. SAPIRO, “Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting”, Proc. IEEE

Computer Vision and Pattern Recognition (CVPR’01), Hawaii, December 2001. http://www.iua.upf.es/~mbertalmio/final-cvpr.pdf

C. BALLESTER, M. BERTALMIO, V. CASELLES, G. SAPIRO, AND J. VERDERA, "Filling-in by Joint Interpolation of Vector Fields

and Gray Levels", IEEE Transaction on Image Processing, 10, Issue 8, Aug 2001, Page(s): 1200 - 1211.

M.M. OLIVIEIRA, B. BOWEN, R. MCKENNA AND Y.S. CHUNG, “Fast Digital Image Inpainting”, Proceedings of the International

Conference on Visualization, Imaging and Image Processing (VIIP 2001), Marbella, Spain 2001. Sep. 3-5, 2001, pp 261-266. URL:

http://www.cs.sunysb.edu/~oliveira/pubs/inpainting.pdf

T. F. CHAN AND J. SHEN, "Non-Texture Inpainting by Curvature-Driven Diffusions (CDD)", Journal Visual Communication and Image

Representation, 12, Number 4, 2001, Page(s): 436 - 449.

M. ASHIKHMIN. “Synthesizing natural textures”. In Proc. ACM Symposium on Interactive 3D Graphics, pages 217–226, Research

Triangle Park, NC, March 2001.

A. EFROS and W.T. FREEMAN, “Image quilting for texture synthesis and transfer”. In Proc. ACM Conf. Comp. Graphics (SIGGRAPH),

pages 341–346, Eugene Fiume, August 2001.

A. HERTZMANN, C. JACOBS, N. OLIVER, B. CURLESS, and D. SALESIN, “Image analogies”. In Proc. ACM Conf. Comp. Graphics

(SIGGRAPH), Eugene Fiume, August 2001.

C. BALLESTER, V. CASELLES, J. VERDERA, M. BERTALMIO, and G. SAPIRO. “A variational model for filling-in gray level and

color images”. In Proc. Int. Conf. Computer Vision, pages I: 10–16, Vancouver, Canada, June 2001.

P.Harrison, “A non-hierarchical procedure for re-synthesis of complex texture”, in Proc. Int. Conf. Central Europe Computer Graphics,

Visualization And Computer Vision, Plzen, Czech Republic, February 2001.

S. MASNOU, "Disocclusion: A Variational Approach using Level Lines", IEEE Transactions on Signal Processing, 11, Issue 2, Feb 2002,

Page(s): 68- 76.

R. BORNARD, E. LECAN, L. LABORELLI AND J-H. CHENOT, “Missing Data Correction in Still Images and Image Sequences”, ACM

Multimedia 2002, Juan-les-Pins, France, Dec. 2002. URL: http://brava.ina.fr/papers/INA_Raphael_Bornard/RBornard_mm2002_preprint.pdf

T.F. CHAN, J. SHEN AND L. VESE, “Variational PDE Models in Image Processing”, UCLA Computational and Applied Mathematics

Reports 02-61, Dec. 2002. URL: ftp://ftp.math.ucla.edu/pub/camreport/cam02-61.pdf

J. SHEN, “Inpainting and the Fundamental Problem of Image Processing”, SIAM News 36(5), June 2003.

http://www.math.ucla.edu/~imagers/htmls/internalreport/ShenSIAM.pdf

M. BERTALMIO, L. VESE, G. SAPIRO AND S. OSHER, “Simultaneous Structure and Texture Image Inpainting”, in Proc. Conference

Computer Vision Pattern Recognition, Madison, WI, 2003. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision

and Pattern Recognition (CVPR’03), volume 2, June 2003. URL: http://www.math.ucla.edu/~lvese/PAPERS/01211536.pdf

A. CRIMINISI, P. PÉRES AND K. TOYAMA, "Region Filling and Object Removal by Exemplar-Based Image Inpainting"., IEEE Trans

on Image Processing , vol. 13, NO. 9, sep 2004

I. DRORI, D. COHEN-OR AND H. YESHURUN, “Fragment-Based Image Completion”, ACM Transactions on Graphics (TOG), volume

issue 3, July 2003. URL: http://portal.acm.org

[ 27] S.PADMAVATHI, K.P.SOMAN ,Comparative Analysis of Structure and Texture based Image Inpainting Techniques, International

Journal of Electronics and Computer Science Engineering,( IJECSE )Volume 1, Number 3, June 2012, pp1062-1069

S.PADMAVATHI, N.ARCHANA, K.P.SOMAN , Hierarchical Approach For Total Variation Digital Image Inpainting,

International Journal of Computer Science, Engineering and Applications (IJCSEA), Volume 2, number 3, june 2012, PP173-182

S.PADMAVATHI, K.P.SOMAN, A Hierarchical Search Space Refinement and filling for Exemplar based Image Inpainting, International

Journal of Computer Applications (IJCA) Volume 52, number4, August 2012, pp31-37.

] S.PADMAVATHI, B. PRIYA LAKSHMI, K.P.SOMAN, Hierarchical Digital Image Inpainting using Wavelets , Signal

& Image Processing : An International Journal ( SIPIJ ) , Volume 3 , Number 4 , August 2012, pp 85-93.

Downloads

Published

2014-02-10

How to Cite

Padmavathi, S., & Soman, K. P. (2014). LAPLACIAN PYRAMID BASED HIERARCHICAL IMAGE INPAINTING. European Journal of Applied Sciences, 2(1), 09–22. https://doi.org/10.14738/aivp.21.46