article

Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique

Authors:

G. CristóbalAuthors Info & Claims

Information Fusion, Volume 10, Issue 2

Pages 163 - 171

https://doi.org/10.1016/j.inffus.2008.08.006

Published: 01 April 2009 Publication History

Abstract

Today, multiresolution (MR) transforms are a widespread tool for image fusion. They decorrelate the image into several scaled and oriented sub-bands, which are usually averaged over a certain neighborhood (window) to obtain a measure of saliency. First, this paper aims to evaluate log-Gabor filters, which have been successfully applied to other image processing tasks, as an appealing candidate for MR image fusion as compared to other wavelet families. Consequently, this paper also sheds further light on appropriate values for MR settings such as the number of orientations, number of scales, overcompleteness and noise robustness. Additionally, we revise the novel Multisize Windows (MW) technique as a general approach for MR frameworks that exploits advantages of different window sizes. For all of these purposes, the proposed techniques are firstly assessed on simulated noisy experiments of multifocus fusion and then on a real microscopy scenario.

References

[1]

Y. Wang, B. Lohmann, Multisensor image fusion: concept, method and applications, Tech. rep., Univ. Bremen., 2000.

[2]

Burt, P.J. and Adelson, E.H., The Laplacian pyramid as a compact image code. IEEE Trans. Commun. v31 i4. 532-540.

[3]

Pu, T. and Ni, G., Contrast-based image fusion using the discrete wavelet transform. Opt. Eng. v39 i8. 2075-2082.

[4]

Burt, P.J., A gradient pyramid basis for pattern-selective image fusion. Soc. Inform. Display Digest Tech. Papers. v16. 467-470.

[5]

Toet, A., A morphological pyramidal image decomposition. Pattern Recogn. Lett. v9 i4. 255-261.

[6]

Toet, A., Image fusion by a ratio of low-pass pyramid. Patten Recogn. Lett. v9 i4. 245-253.

[7]

Wang, H.H., A new multiwavelet-based approach to image fusion. J. Math. Imaging Vis. v21 i2. 177-192.

[8]

Li, H., Manjunath, B.S. and Mitra, S.K., Multisensor image fusion using the wavelet transform. Graph. Models Image Process. v57 i3. 235-245.

[9]

Toet, A., Hierarchical image fusion. Mach. Vis. Appl. v3 i1. 1-11.

[10]

Zhang, Z. and Blum, R.S., A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application. Proc. IEEE. v87 i8. 1315-1326.

[11]

Subbarao, M., Choi, T. and Nikzad, A., Focusing techniques. J. Opt. Eng. v32 i11. 2824-2836.

[12]

Subbarao, M. and Tyan, J.K., Selecting the optimal focus measure for autofocusing and depth-from-focus. IEEE Trans. PAMI. v20 i8. 864-870.

[13]

Zhang, Y., Zhang, Y. and Wen, C., A new focus measure method using moments. Image Vis. Comput. v18 i12. 959-965.

[14]

Kautsky, J., Flusser, J., Zitová, B. and Šimberová, S., A new wavelet-based measure of image focus. Pattern Recogn. Lett. v23 i14. 1785-1794.

[15]

Piella, G., A general framework for multiresolution image fusion: from pixels to regions. Inform. Fus. v4 i4. 259-280.

[16]

G. Piella, H. Heijmans, A new quality metric for image fusion, in: IEEE International Conference on Image Processing, ICIP, 2003, pp. 173-176.

[17]

Toet, A. and Franken, E.M., Perceptual evaluation of different image fusion schemes. Displays. v24 i1. 25-37.

[18]

V. Petrović, C. Xydeas, Evaluation of image fusion performance with visible differences, in: Proceedings of ECCV, vol. 3023, 2004, pp. 380-391.

[19]

Fischer, S., Sroubek, F., Perrinet, L., Redondo, R. and Cristóbal, G., Self-invertible log-Gabor wavelets. Int. J. Comput. Vis. v75 i2. 231-246.

[20]

Fischer, S., Cristóbal, G. and Redondo, R., Sparse overcomplete Gabor wavelet representation based on local competitions. IEEE Trans. Image Process. v15 i2. 265-272.

[21]

S. Fischer, R. Redondo, L. Perrinet, G. Cristóbal, Sparse approximation of images inspired from the functional architecture of the primary visual areas, EURASIP JASP, in press, 2007 (special issue on Visual Perception).

[22]

R. Redondo, F. Sroubek, S. Fischer, G. Cristóbal, Multifocus fusion with multisize windows, in: A.G. Tescher (Ed.), Proceedings of the SPIE Applications of Digital Image Processing XXVIII, vol. 5909, 2005.

[23]

Shapiro, J.M., Embedded image coding using zero trees of wavelet coefficients. IEEE Trans. Signal Process. v41 i12. 3445-3462.

[24]

Srivastava, A., Lee, A.B., Simoncelli, E.P. and Zhu, S.C., On advances in statistical modeling of natural images. J. Math. Imaging Vis. v18 i1. 17-33.

[25]

Gabor, D., Theory of communication. J. Inst. Electr. Eng. v93. 429-457.

[26]

Lawton, W., Applications of complex valued wavelet transforms to subband decomposition. IEEE Trans. Signal Process. v41 i12. 3566-3568.

[27]

Forster, B., Van De Ville, D., Berent, J., Sage, D. and Unser, M., Complex wavelets for extended depth-of-field: a new method for the fusion of multichannel microscopy images. Microsc. Res. Tech. v65 i1-2. 33-42.

[28]

Simoncelli, E.P., Freeman, W.T., Adelson, E.H. and Heeger, D.J., Shiftable multiscale transforms. IEEE Trans. Inform. Theory. v38 i2. 587-607.

[29]

I. Koren, A. Laine, F. Taylor, Image fusion using steerable dyadic wavelet transform, in: Proceedings of IEEE International Conference on Image Processing, vol. 3, 1995, pp. 232-235.

[30]

O. Rockinger, Image sequence fusion using shift invariant wavelet transform, in: Proceedings of IEEE International Conference on Image Processing, vol. 3, 1997, pp. 288-291.

[31]

Gonzalez, R.C. and Woods, R.E., Digital Image Processing. 2002. Prentice Hall, New Jersey.

[32]

Portilla, J., Strela, V., Wainwright, M. and Simoncelli, E., Image denoising using scale mixtures of Gaussians in the wavelet domain. IEEE Trans. Image Process. v12 i11. 1338-1351.

[33]

Pieper, R.J. and Korpel, A., Image processing for extended depth of field. Appl. Opt. v22 i10. 1449-1453.

[34]

Sugimoto, S.A. and Ichioka, Y., Digital composition of image with increased depth of focus considering depth information. Appl. Opt. v24 i14. 2076-2080.

[35]

V. Tympel, New high-level image capture system for conventional microscopy, in: Proceedings of SPIE Medical Imaging: Image Display, vol. 2707, 1996, pp. 529-536.

[36]

Valdecasas, A.G., Marshall, D., Becerra, J.M. and Terrero, J.J., On the extended depth of focus algorithms for bright field microscopy. Micron. v32. 559-569.

[37]

Sweldens, W., The lifting scheme: a construction of second generation wavelets. SIAM J. Math. v29 i2. 511-546.

Cited By

Choudhary GSethi D(2023)Mathematical modeling and simulation of multi-focus image fusion techniques using the effect of image enhancement criteria: a systematic review and performance evaluationArtificial Intelligence Review10.1007/s10462-023-10487-356:11(13787-13839)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1007/s10462-023-10487-3
Vishwakarma ABhuyan M(2022)A curvelet-based multi-sensor image denoising for KLT-based image fusionMultimedia Tools and Applications10.1007/s11042-021-11570-z81:4(4991-5016)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s11042-021-11570-z
Hu FHu CDu WKang GHan Y(2021)A New Medical Image Fusion Approach Using Spatial Attention and Weighted Local EnergyProceedings of the 2021 8th International Conference on Biomedical and Bioinformatics Engineering10.1145/3502871.3502872(1-6)Online publication date: 12-Nov-2021
https://dl.acm.org/doi/10.1145/3502871.3502872
Show More Cited By

Index Terms

Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
      2. Computer vision tasks
        Vision for robotics
  2. Computer graphics
    1. Image manipulation
2. Mathematics of computing
  1. Mathematical analysis
    1. Numerical analysis
      1. Computation of transforms

Recommendations

Multifocus image fusion by combining curvelet and wavelet transform

When an image is captured by CCD device, only the objects at focus plane would appear sharp. A practicable way to get an image with all objects in focus is to fuse images acquired with different focus levels of the scene. In this paper, we propose a ...
A New Image Denoising Method Using Wavelet Transform
IFITA '09: Proceedings of the 2009 International Forum on Information Technology and Applications - Volume 01

Wavelet image denoising has been widely used in the field of image noise. After taking into account the objective and subjective results of the noise image, this paper presents a new image denosing method. Firstly, this method decomposes the noisy image ...
Edge preserving image fusion based on contourlet transform
ICISP'12: Proceedings of the 5th international conference on Image and Signal Processing

Image fusion is an emerging area of research having a number of applications in medical imaging, remote sensing, satellite imaging, target tracking, concealed weapon detection and biometrics. In the present work, we have proposed a new edge preserving ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Copyright © Elsevier B.V. © 2008.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 April 2009

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Choudhary GSethi D(2023)Mathematical modeling and simulation of multi-focus image fusion techniques using the effect of image enhancement criteria: a systematic review and performance evaluationArtificial Intelligence Review10.1007/s10462-023-10487-356:11(13787-13839)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1007/s10462-023-10487-3
Vishwakarma ABhuyan M(2022)A curvelet-based multi-sensor image denoising for KLT-based image fusionMultimedia Tools and Applications10.1007/s11042-021-11570-z81:4(4991-5016)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s11042-021-11570-z
Hu FHu CDu WKang GHan Y(2021)A New Medical Image Fusion Approach Using Spatial Attention and Weighted Local EnergyProceedings of the 2021 8th International Conference on Biomedical and Bioinformatics Engineering10.1145/3502871.3502872(1-6)Online publication date: 12-Nov-2021
https://dl.acm.org/doi/10.1145/3502871.3502872
Singh PDiwakar MCheng XShankar A(2021)A new wavelet-based multi-focus image fusion technique using method noise and anisotropic diffusion for real-time surveillance applicationJournal of Real-Time Image Processing10.1007/s11554-021-01125-818:4(1051-1068)Online publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1007/s11554-021-01125-8
Dou JQin QTu Z(2019)Image fusion based on wavelet transform with genetic algorithms and human visual systemMultimedia Tools and Applications10.1007/s11042-018-6756-078:9(12491-12517)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1007/s11042-018-6756-0
Wang GLi WYin XYang H(2018)All-in-focus with directional-max-gradient flow and labeled iterative depth propagationPattern Recognition10.5555/3199224.319928177:C(173-187)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.5555/3199224.3199281
Li HQiu HYu ZLi B(2017)Multifocus image fusion via fixed window technique of multiscale images and non-local means filteringSignal Processing10.1016/j.sigpro.2017.03.008138:C(71-85)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1016/j.sigpro.2017.03.008
Li SKang XFang LHu JYin H(2017)Pixel-level image fusionInformation Fusion10.1016/j.inffus.2016.05.00433:C(100-112)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1016/j.inffus.2016.05.004
Li HLiu XYu ZZhang Y(2016)Performance improvement scheme of multifocus image fusion derived by difference imagesSignal Processing10.1016/j.sigpro.2016.05.015128:C(474-493)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1016/j.sigpro.2016.05.015
Li HLi XYu ZMao C(2016)Multifocus image fusion by combining with mixed-order structure tensors and multiscale neighborhoodInformation Sciences: an International Journal10.1016/j.ins.2016.02.030349:C(25-49)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1016/j.ins.2016.02.030
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents