Article

Optimising Region of Interest Registration for Multiple-Tissue Whole Slide Images

Authors:

Alessio Fiorin,

Laia Adalid Llansa,

Vincenzo Della Mea,

Anna Korzynska,

Shrief Abdelazeez,

Ramon Bosch Príncep,

Alba Fischer Carles,

Noelia Gallardo Borràs,

Marylène Lejeune,

Daniel Mata Cano,

Hatem A. Rashwan,

Esther Sauras Colón,

Mikel Relloso Ortiz de Uriarte,

Laia Reverté Calvet,

Carlos López PabloAuthors Info & Claims

Biomedical Image Registration: 11th International Workshop, WBIR 2024, Held in Conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings

Pages 333 - 345

https://doi.org/10.1007/978-3-031-73480-9_26

Published: 06 October 2024 Publication History

Abstract

Digital pathology transforms clinical workflows by enabling the analysis of whole slide images (WSIs) on computers. While most methods focus on haematoxylin and eosin (H&E) stained WSIs, immunohistochemistry (IHC) is crucial for biomarker analysis, particularly for assessing tumour-infiltrating lymphocyte (TIL) subtypes inside a region of interest (ROI) selected by a pathologist using Salgado’s criteria. This study first investigates the naive approach, which verifies a state-of-the-art WSI registration method’s robustness for registering single-tissue H&E and multiple-tissue IHC WSIs. Then, to simplify this first attempt by accomplishing registration between single tissues, the study proposes two approaches: splitting the multiple-tissue IHC WSIs, which is considered the baseline, and a virtualised splitting with an incremental resolution optimisation-based technique. ROI registration predictions for TIL assessment will be assessed on IHC WSIs using standard metrics and one derived from a standard landmark-based metric popular in the image registration field. Existing image detection-inspired metrics for evaluating ROI proposals will be proposed and tuned to consider the global viewpoint, where the ROI proposals lie. This study aims to establish a reliable and time-efficient ROI registration procedure for WSIs with multiple stained tissues. This method would enable efficient selection of the ROI from the H&E WSI and potentially reduce the need for pathologist intervention through automatic quality control.

References

[1]

Weitz, P., Valkonen, M., Solorzano, L., Carr, C., Kartasalo, K., Boissin, C., Koivukoski, S., Kuusela, A., Rasic, D., Feng, Y., et al.: The ACROBAT 2022 challenge: automatic registration of breast cancer tissue. arXiv preprint arXiv:2305.18033 (2023)

[2]

Nam, S., Chong, Y., Jung, C.K., Kwak, T.Y., Lee, J.Y., Park, J., Rho, M.J., Go, H.: Introduction to digital pathology and computer-aided pathology. Journal of pathology and translational medicine 54(2), 125 (2020)

[3]

Baxi, V., Edwards, R., Montalto, M., Saha, S.: Digital pathology and artificial intelligence in translational medicine and clinical practice. Modern Pathology 35(1), 23–32 (2022)

[4]

Salgado, R., Denkert, C., Demaria, S., Sirtaine, N., Klauschen, F., Pruneri, G., Wienert, S., Van den Eynden, G., Baehner, F.L., Pénault-Llorca, F., et al.: The evaluation of tumor-infiltrating lymphocytes (TILs) in breast cancer: recommendations by an International TILs Working Group 2014. Annals of oncology 26(2), 259–271 (2015)

[5]

Fortis, S.P., Sofopoulos, M., Sotiriadou, N.N., Haritos, C., Vaxevanis, C.K., Anastasopoulou, E.A., Janssen, N., Arnogiannaki, N., Ardavanis, A., Pawelec, G., et al.: Differential intratumoral distributions of CD8 and CD163 immune cells as prognostic biomarkers in breast cancer. Journal for immunotherapy of cancer 5, 1–12 (2017)

[6]

Fiorin, A., López Pablo, C., Lejeune, M., Hamza Siraj, A., Della Mea, V.: Enhancing AI Research for Breast Cancer: A Comprehensive Review of Tumor-Infiltrating Lymphocyte Datasets. Journal of Imaging Informatics in Medicine pp. 1–13 (2024)

[7]

Smit, G., Ciompi, F., Cigéhn, M., Bodén, A., Van Der Laak, J., Mercan, C.: Quality control of whole-slide images through multi-class semantic segmentation of artifacts. In: Medical Imaging with Deep Learning (2021)

[8]

Schömig-Markiefka, B., Pryalukhin, A., Hulla, W., Bychkov, A., Fukuoka, J., Madabhushi, A., Achter, V., Nieroda, L., Büttner, R., Quaas, A., et al.: Quality control stress test for deep learning-based diagnostic model in digital pathology. Modern Pathology 34(12), 2098–2108 (2021)

[9]

Schreiber, B., Denholm, J., Jaeckle, F., Arends, M.J., Branson, K., Schönlieb, C.B., Soilleux, E.: Rapid artefact removal and H &E-stained tissue segmentation. Scientific Reports 14(1), 309 (2024)

[10]

Gatenbee, C.D., Baker, A.M., Prabhakaran, S., Swinyard, O., Slebos, R.J., Mandal, G., Mulholland, E., Andor, N., Marusyk, A., Leedham, S., et al.: Virtual alignment of pathology image series for multi-gigapixel whole slide images. Nature communications 14(1), 4502 (2023)

[11]

Weitz, P., Valkonen, M., Solorzano, L., Carr, C., Kartasalo, K., Boissin, C., Koivukoski, S., Kuusela, A., Rasic, D., Feng, Y., et al.: ACROBAT–a multi-stain breast cancer histological whole-slide-image data set from routine diagnostics for computational pathology. arXiv preprint arXiv:2211.13621 (2022)

[12]

Borovec, J., Kybic, J., Arganda-Carreras, I., Sorokin, D.V., Bueno, G., Khvostikov, A.V., Bakas, S., Eric, I., Chang, C., Heldmann, S., et al.: ANHIR: automatic non-rigid histological image registration challenge. IEEE transactions on medical imaging 39(10), 3042–3052 (2020)

[13]

Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., Savarese, S.: Generalized intersection over union: A metric and a loss for bounding box regression. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 658–666 (2019)

[14]

Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., Ren, D.: Distance-IoU loss: Faster and better learning for bounding box regression. In: Proceedings of the AAAI conference on artificial intelligence. vol. 34, pp. 12993–13000 (2020)

[15]

Bankhead, P., Loughrey, M.B., Fernández, J.A., Dombrowski, Y., McArt, D.G., Dunne, P.D., McQuaid, S., Gray, R.T., Murray, L.J., Coleman, H.G., et al.: QuPath: Open source software for digital pathology image analysis. Scientific reports 7(1), 1–7 (2017)

[16]

Leutenegger, S., Chli, M., Siegwart, R.Y.: Brisk: Binary robust invariant scalable keypoints. In: 2011 International Conference on Computer Vision. pp. 2548–2555 (2011).

Digital Library

[17]

Simonyan, K., Vedaldi, A., Zisserman, A.: Learning local feature descriptors using convex optimisation. IEEE Transactions on Pattern Analysis and Machine Intelligence 36(8), 1573–1585 (2014).

Digital Library

[18]

Cantzler, H.: Random sample consensus (ransac). Institute for Perception, Action and Behaviour, Division of Informatics, University of Edinburgh 3 (1981)

Index Terms

Optimising Region of Interest Registration for Multiple-Tissue Whole Slide Images
1. Applied computing
  1. Life and medical sciences
    1. Computational biology
      1. Imaging
    2. Health care information systems
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
  2. Computer graphics
    1. Image manipulation
      1. Image processing

Index terms have been assigned to the content through auto-classification.

Recommendations

Whole Slide Image Registration for the Study of Tumor Heterogeneity
Computational Pathology and Ophthalmic Medical Image Analysis
Abstract
Consecutive thin sections of tissue samples make it possible to study local variation in e.g. protein expression and tumor heterogeneity by staining for a new protein in each section. In order to compare and correlate patterns of different ...
Validation of direct registration of whole-mount prostate digital histopathology to ex vivo MR images
MICCAI'11: Proceedings of the 2011 international conference on Prostate cancer imaging: image analysis and image-guided interventions

Accurate determination of cancer stage and grade from in vivo prostate imaging could improve biopsy guidance, therapy selection and, possibly, focal therapy guidance. Validating prostate cancer imaging ideally requires accurate 3D registration of in ...
Automated segmentation of cell membranes to evaluate HER2 status in whole slide images using a modified deep learning network
Abstract
The uncontrollable growth of cells in the breast tissue causes breast cancer which is the second most common type of cancer affecting women in the United States. Normally, human epidermal growth factor receptor 2 (HER2) proteins are ...
Highlights
- HER2 overexpression is a prognostic marker in invasive breast cancer.
- Provided ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Biomedical Image Registration: 11th International Workshop, WBIR 2024, Held in Conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings

Oct 2024

377 pages

ISBN:978-3-031-73479-3

DOI:10.1007/978-3-031-73480-9

Editors:
Marc Modat
King's College London, London, UK
,
Ivor Simpson
University of Sussex, Brighton, UK
,
Žiga Špiclin
University of Ljubljana, Ljubljana, Slovenia
,
Wietske Bastiaansen
https://ror.org/018906e22Erasmus MC, Rotterdam, The Netherlands
,
Alessa Hering
Radboud University Medical Center, Nijmegen, The Netherlands
,
Tony C. W. Mok
https://ror.org/00q4vv597Hong Kong University of Science and Technology, Hong Kong, China

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 06 October 2024

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Affiliations

Alessio Fiorin

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Tarragona, Spain

https://orcid.org/0009-0002-0315-1085

Laia Adalid Llansa

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

https://orcid.org/0000-0001-7543-9921

Elena Goyda

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

https://orcid.org/0009-0009-8797-9269

Vincenzo Della Mea

Department of Mathematics, Computer Science and Physics, University of Udine, Udine, Italy

https://orcid.org/0000-0002-0144-3802

Anna Korzynska

Laboratory of Processing and Analysis of Microscopic Images, Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland

https://orcid.org/0000-0002-6488-4832

Shrief Abdelazeez

Laboratory of Processing and Analysis of Microscopic Images, Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland

https://orcid.org/0000-0002-4361-8404

Ramon Bosch Príncep

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

https://orcid.org/0000-0003-4104-5515

Alba Fischer Carles

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

BCN MedTech, Department of Engineering, Universitat Pompeu Fabra, Barcelona, Spain

https://orcid.org/0009-0005-7733-015X

Noelia Gallardo Borràs

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

Campus Terres de l’Ebre, Universitat Rovira i Virgili, Tortosa, Spain

https://orcid.org/0000-0001-8537-4586

Marylène Lejeune

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Tarragona, Spain

https://orcid.org/0000-0001-8441-9404

Daniel Mata Cano

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

https://orcid.org/0000-0001-7543-4856

Domenec Puig

Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Tarragona, Spain

https://orcid.org/0000-0002-0562-4205

Hatem A. Rashwan

Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Tarragona, Spain

https://orcid.org/0000-0001-5421-1637

Esther Sauras Colón

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

Campus Terres de l’Ebre, Universitat Rovira i Virgili, Tortosa, Spain

https://orcid.org/0000-0003-1649-938X

Mikel Relloso Ortiz de Uriarte

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

https://orcid.org/0009-0003-1867-1822

Laia Reverté Calvet

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

https://orcid.org/0000-0003-4690-2387

Carlos López Pablo

Oncological Pathology and Bioinformatics Research Group, Institut d’Investigació Sanitària Pere Virgili, Tortosa, Spain

Department of Pathology, Hospital de Tortosa Verge de la Cinta, Institut Català de la Salut, Tortosa, Spain

Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, Tarragona, Spain

https://orcid.org/0000-0003-1248-3065

View Table of Contents