article

Free access

Jointmotion estimation and layer segmentation in transparent image sequenc: application to noise reduction in X-ray image sequences

Authors:

Vincent Auvray,

Patrick Bouthemy,

Jean LiénardAuthors Info & Claims

EURASIP Journal on Advances in Signal Processing, Volume 2009

Article No.: 19, Pages 1 - 21

https://doi.org/10.1155/2009/647262

Published: 01 January 2009 Publication History

Abstract

This paper is concerned with the estimation of the motions and the segmentation of the spatial supports of the different layers involved in transparent X-ray image sequences. Classical motion estimation methods fail on sequences involving transparent effects since they do not explicitly model this phenomenon. We propose a method that comprises three main steps: initial block-matching for two-layer transparent motion estimation, motion clustering with 3D Hough transform, and joint transparent layer segmentation and parametric motion estimation. It is validated on synthetic and real clinical X-ray image sequences. Secondly, we derive an original transparent motion compensation method compatible with any spatiotemporal filtering technique. A direct transparentmotion compensation method is proposed. To overcome its limitations, a novel hybrid filter is introduced which locally selects which type of motion compensation is to be carried out for optimal denoising. Convincing experiments on synthetic and real clinical images are also reported.

References

[1]

V. Auvray, P. Bouthemy, and J. Liénard, "Motion-based segmentation of transparent layers in video sequences," in Proceedings of International Workshop of Multimedia Content Representation, Classification and Security (MRCS '06), vol. 4105 of Lecture Notes in Computer Science, pp. 298-305, Istanbul, Turkey, September 2006.

Digital Library

[2]

B. Horn and B. Schunk, "Determining optical flow," Artificial Intelligence, vol. 17, no. 1-3, pp. 185-203, 1981.

Digital Library

[3]

Y. Weiss, "Deriving intrinsic images from image sequences," in Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV '01), vol. 2, pp. 68-75, Vancouver, Canada, July 2001.

[4]

B. Sarel and M. Irani, "Separating transparent layers through layer information exchange," in Proceedings of the 8th European Conference on Computer Vision (ECCV '04), vol. 3024 of Lecture Notes in Computer Science, pp. 328-341, Prague, Czech Republic, May 2004.

[5]

B. Sarel and M. Irani, "Separating transparent layers of repetitive dynamic behaviors," in Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV '05), vol. 1, pp. 26-32, Beijing, China, October 2005.

Digital Library

[6]

M. Black and P. Anandan, "The robust estimation of multiple motions: parametric and piecewise-smooth flow field," Computer Vision and Image Understanding, vol. 19, no. 1, pp. 57-91, 1996.

Digital Library

[7]

M. Irani, B. Rousso, and S. Peleg, "Computing occluding and transparent motions," International Journal of Computer Vision, vol. 12, no. 1, pp. 5-16, 1994.

Digital Library

[8]

R. A. Close, C. K. Abbey, C. A. Morioka, and J. S. Whiting, "Accuracy assessment of layer decomposition using simulated angiographic image sequences," IEEE Transactions on Medical Imaging, vol. 20, no. 10, pp. 990-998, 2001.

[9]

W. Yu, G. Sommer, and K. Daniilidis, "Multiple motion analysis: in spatial or in spectral domain?" Computer Vision and Image Understanding, vol. 90, no. 2, pp. 129-152, 2003.

Digital Library

[10]

P. Milanfar, "Two-dimensional matched filtering for motion estimation," IEEE Transactions on Image Processing, vol. 8, no. 3, pp. 438-444, 1999.

Digital Library

[11]

M. Pingault and D. Pellerin, "Motion estimation of transparent objects in the frequency domain," Signal Processing, vol. 84, no. 4, pp. 709-719, 2004.

Digital Library

[12]

M. Shizawa and K. Mase, "Principle of superposition: a common computational framework for analysis of multiple motion," in Proceedings of the IEEE Workshop on Visual Motion (WVM '91), pp. 164-172, Princeton, NJ, USA, October 1991.

[13]

M. Pingault, E. Bruno, and D. Pellerin, "A robust multiscale B-spline function decomposition for estimating motion transparency," IEEE Transactions on Image Processing, vol. 12, no. 11, pp. 1416-1426, 2003.

Digital Library

[14]

I. Stuke, T. Aach, C. Mota, and E. Barth, "Estimation of multiple motions: regularization and performance evaluation," in Image and Video Communications and Processing 2003, vol. 5022 of Proceedings of SPIE, pp. 75-86, Santa Clara, Calif, USA, January 2003.

[15]

I. Stuke, T. Aach, E. Barth, and C. Mota, "Estimation of multiple motions using block-matching and Markov random fields," in Visual Communications and Image Processing (VCIP '04), vol. 5308 of Proceedings of SPIE, pp. 486-496, San Jose, Calif, USA, January 2004.

[16]

M. Pingault and D. Pellerin, "Optical flow constraint equation extended to transparency," in Proceedings of the 11th European Signal Processing Conference (EUSIPCO '02), Toulouse, France, September 2002.

[17]

I. Stuke, T. Aach, C. Mota, and E. Barth, "Estimation of multiple motions using block-matching and Markov random fields," in Proceedings of the 4th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD '03), pp. 358-362, Luebeck, Germany, October 2003.

[18]

J. Toro, F. Owens, and R. Medina, "Multiple motion estimation and segmentation in transparency," in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '00), vol. 6, pp. 2087-2090, Istanbul, Turkey, June 2000.

Digital Library

[19]

D. Murray and H. Buxton, "Scene segmentation from visual motion using global optimization," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 9, no. 2, pp. 220-228, 1987.

Digital Library

[20]

P. Bouthemy and E. Francois, "Motion segmentation and qualitative dynamic scene analysis from an image sequence," International Journal of Computer Vision, vol. 10, no. 2, pp. 157-182, 1993.

Digital Library

[21]

Y. Weiss and E. Adelson, "A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '96), pp. 321-326, San Francisco, Calif, USA, June 1996.

Digital Library

[22]

H. Sawhney and S. Ayer, "Compact representations of videos through dominant and multiple motion estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 814-830, 1996.

Digital Library

[23]

J.-M. Odobez and P. Bouthemy, "Direct incremental model-based image motion segmentation for video analysis," Signal Processing, vol. 66, no. 2, pp. 143-155, 1998.

Digital Library

[24]

N. Paragios and R. Deriche, "Geodesic active regions and level set methods for motion estimation and tracking," Computer Vision and Image Understanding, vol. 97, no. 3, pp. 259-282, 2005.

Digital Library

[25]

P. Hubert, Robust Statistics, John Wiley & Sons, New York, NY, USA, 1981.

[26]

J. M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," Journal of Visual Communication and Image Representation, vol. 6, no. 4, pp. 348-365, 1995.

[27]

P. Holland and R. Welsch, "Robust regression using iteratively reweighted least-squares," Communication Statistic-Theory Method A, vol. 6, no. 9, pp. 813-827, 1977.

[28]

J.C. Brailean, R. P. Kleihorst, S. Efstratiadis, A. K. Katsaggelos, and R. L. Lagendijk, "Noise reduction filters for dynamic image sequences: a review," Proceedings of the IEEE, vol. 83, no. 9, pp. 1272-1292, 1995.

[29]

E. H. W. Meijering, K. J. Zuiderveld, and M. A. Viergever, "Image registration for digital subtraction angiography," International Journal of Computer Vision, vol. 31, no. 2, pp. 227-246, 1999.

Digital Library

[30]

S. Baert, M. Viergever, and W. Niessen, "Guide-wire tracking during endovascular interventions," IEEE Transactions on Medical Imaging, vol. 22, no. 8, pp. 965-972, 2003.

[31]

V. Nzomigni, C. Labit, and J. Liénard, "Motion-compensated lossless compression schemes for biomedical sequence storage," in Proceedings of International Picture Coding Symposium (PCS '93), Lausanne, Switzerland, March 1993.

[32]

Y. Boykov and G. Funka-Lea, "Graph cuts and efficient ND image segmentation," International Journal of Computer Vision, vol. 70, no. 2, pp. 109-131, 2006.

Digital Library

[33]

V. Auvray, J. Liénard, and P. Bouthemy, "Multiresolution parametric estimation of transparent motions and denoising of fluoroscopic images," in Proceedings of the 8th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '05), vol. 3750 of Lecture Notes in Computer Science, pp. 352-359, Palm Springs, Calif, USA, October 2005.

Digital Library

[34]

A. Macovski, Medical Imaging Systems, Prentice-Hall, Edgewood Cliffs, NJ, USA, 2nd edition, 2004.

[35]

T. Aach, U. Schiebel, and G. Spekowius, "Digital image acquisition and processing in medical x-ray imaging," Journal of Electronic Imaging, vol. 8, no. 1, pp. 7-22, 1999.

[36]

F. Anscombe, "The transformation of poisson, binomial and negative-binomial data," Biometrika, vol. 35, no. 3-4, pp. 246-254, 1948.

Cited By

Medathati NNeumann HMasson GKornprobst P(2016)Bio-inspired computer visionComputer Vision and Image Understanding10.1016/j.cviu.2016.04.009150:C(1-30)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.cviu.2016.04.009
Preston JRottman CCheryauka AAnderton LWhitaker RJoshi S(2013)Multi-layer deformation estimation for fluoroscopic imagingProceedings of the 23rd international conference on Information Processing in Medical Imaging10.1007/978-3-642-38868-2_11(123-134)Online publication date: 28-Jun-2013
https://dl.acm.org/doi/10.1007/978-3-642-38868-2_11

Index Terms

Jointmotion estimation and layer segmentation in transparent image sequenc: application to noise reduction in X-ray image sequences
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems
2. Computing methodologies

Recommendations

Segmentation and Factorization-Based Motion and Structure Estimation for Long Image Sequences

This paper presents a computer algorithm which, given a dense temporal sequence of intensity images of multiple moving objects, will separate the images into regions showing distinct objects, and, for those objects which are rotating, will calculate the ...
Velocity tuned filters for motion estimation and segmentation in digital image sequences

This paper addresses the problem of motion estimation, selective reconstruction, and motion-based segmentation of objects undergoing rotational and translational motion and expansion, contraction, or shear type deformation. The goal for motion ...
Image sequence coding using multiple-level segmentation and affine motion estimation

A very low bit-rate video codec using multiple-level segmentation and affine motion compensation is presented. The translational motion model is adequate to motion compensate small regions even when complex motion is involved; however, it is no longer ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image EURASIP Journal on Advances in Signal Processing

EURASIP Journal on Advances in Signal Processing Volume 2009, Issue

January 2009

783 pages

ISSN:1110-8657

Issue’s Table of Contents

Publisher

Hindawi Limited

London, United Kingdom

Publication History

Accepted: 06 April 2009

Published: 01 January 2009

Received: 27 November 2008

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
88
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)6

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Medathati NNeumann HMasson GKornprobst P(2016)Bio-inspired computer visionComputer Vision and Image Understanding10.1016/j.cviu.2016.04.009150:C(1-30)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.cviu.2016.04.009
Preston JRottman CCheryauka AAnderton LWhitaker RJoshi S(2013)Multi-layer deformation estimation for fluoroscopic imagingProceedings of the 23rd international conference on Information Processing in Medical Imaging10.1007/978-3-642-38868-2_11(123-134)Online publication date: 28-Jun-2013
https://dl.acm.org/doi/10.1007/978-3-642-38868-2_11

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents