Abstract
As digitized paintings continue to grow in popularity and become more prevalent on online collection platforms, it becomes necessary to develop new image processing algorithms to effectively manage the paintings stored in databases. Image retrieval has historically been a challenging field within digital image processing, as it requires scanning large databases for images that are similar to a given query image. The notion of similarity itself, varies according to user’s perception. The performance of image retrieval is heavily influenced by the feature representations and similarity measures used. Recently, Deep Learning has made significant strides, and deep features derived from this technology have become widely used due to their demonstrated ability to generalize well. In this paper, a fine-tune Convolutional Neural Network for the artistic genres recognition is employed to extract deep and high-level features from paintings. These features are then used to measure the similarity between a given query image and the images stored in the database, using an Approximate Nearest Neighbours algorithm to get a real time result. Our experimental results indicate this approach leads to a significant improvement in the performance of content-based image retrieval for the task of genre retrieval in paintings.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
References
Alaasam, R., Kurar, B., El-Sana, J.: Layout analysis on challenging historical Arabic manuscripts using siamese network. In: 2019 International Conference on Document Analysis and Recognition (ICDAR), pp. 738–742. IEEE (2019)
Aurenhammer, F.: Voronoi diagrams-a survey of a fundamental geometric data structure. ACM Comput. Surv. (CSUR) 23(3), 345–405 (1991)
Castellano, G., Vessio, G.: Deep learning approaches to pattern extraction and recognition in paintings and drawings: an overview. Neural Comput. Appl. 33(19), 12263–12282 (2021)
Cetinic, E., Lipic, T., Grgic, S.: Fine-tuning convolutional neural networks for fine art classification. Expert Syst. Appl. 114, 107–118 (2018)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Focillon, H.: Vie des formes. Librairie Ernest Leroux Paris (1934)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
Jenicek, T., Chum, O.: Linking art through human poses. In: 2019 International Conference on Document Analysis and Recognition (ICDAR), pp. 1338–1345. IEEE (2019)
Joshi, A., Agrawal, A., Nair, S.: Art style classification with self-trained ensemble of autoencoding transformations. arXiv preprint arXiv:2012.03377 (2020)
Kapoor, R., Sharma, D., Gulati, T.: State of the art content based image retrieval techniques using deep learning: a survey. Multim. Tools Appl. 80(19), 29561–29583 (2021)
Kelek, M.O., Calik, N., Yildirim, T.: Painter classification over the novel art painting data set via the latest deep neural networks. Procedia Comput. Sci. 154, 369–376 (2019)
Latif, A., et al.: Content-based image retrieval and feature extraction: a comprehensive review. Math. Prob. Eng. 2019 (2019)
Li, W., Zhang, Y., Sun, Y., Wang, W., Li, M., Zhang, W., Lin, X.: Approximate nearest neighbor search on high dimensional data-experiments, analyses, and improvement. IEEE Trans. Knowl. Data Eng. 32(8), 1475–1488 (2019)
Liao, Z., Gao, L., Zhou, T., Fan, X., Zhang, Y., Wu, J.: An oil painters recognition method based on cluster multiple kernel learning algorithm. IEEE Access 7, 26842–26854 (2019)
Liu, S., Yang, J., Agaian, S.S., Yuan, C.: Novel features for art movement classification of portrait paintings. Image Vis. Comput. 108, 104121 (2021)
Madhu, P., Kosti, R., Mührenberg, L., Bell, P., Maier, A., Christlein, V.: Recognizing characters in art history using deep learning. In: Proceedings of the 1st Workshop on Structuring and Understanding of Multimedia heritAge Contents, pp. 15–22 (2019)
Saleh, B., Elgammal, A.: Large-scale classification of fine-art paintings: learning the right metric on the right feature. arXiv preprint arXiv:1505.00855 (2015)
Saritha, R.R., Paul, V., Kumar, P.G.: Content based image retrieval using deep learning process. Clust. Comput. 22, 4187–4200 (2019)
Seguin, B., Striolo, C., diLenardo, I., Kaplan, F.: Visual link retrieval in a database of paintings. In: Hua, G., Jégou, H. (eds.) ECCV 2016. LNCS, vol. 9913, pp. 753–767. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46604-0_52
Tan, W.R., Chan, C.S., Aguirre, H.E., Tanaka, K.: Ceci n’est pas une pipe: a deep convolutional network for fine-art paintings classification. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3703–3707. IEEE (2016)
Tan, W.S., Chin, W.Y., Lim, K.Y.: Content-based image retrieval for painting style with convolutional neural network. J. Inst. Eng. Malaysia 82(3) (2021)
Yang, Z.: Classification of picture art style based on vggnet. J. Phys. Conf. Ser. 1774, 012043 (2021). IOP Publishing
Zhang, Z., Sabuncu, M.: Generalized cross entropy loss for training deep neural networks with noisy labels. Adv. Neural Inf. Process. Syst. 31 (2018)
Zhao, W., Zhou, D., Qiu, X., Jiang, W.: Compare the performance of the models in art classification. PLoS ONE 16(3), e0248414 (2021)
Zhong, S.H., Huang, X., Xiao, Z.: Fine-art painting classification via two-channel dual path networks. Int. J. Mach. Learn. Cybern. 11, 137–152 (2020)
Acknowledgement
This work was funded by french national research agency with grant ANR-20-CE38-0017.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Masclef, T., Scuturici, M., Bertin, B., Barrellon, V., Scuturici, VM., Miguet, S. (2024). A Deep Learning Approach for Painting Retrieval Based on Genre Similarity. In: Foresti, G.L., Fusiello, A., Hancock, E. (eds) Image Analysis and Processing - ICIAP 2023 Workshops. ICIAP 2023. Lecture Notes in Computer Science, vol 14366. Springer, Cham. https://doi.org/10.1007/978-3-031-51026-7_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-51026-7_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-51025-0
Online ISBN: 978-3-031-51026-7
eBook Packages: Computer ScienceComputer Science (R0)