Abstract
Scene text recognition is the task of identifying text in natural scene images. Popular scene text recognition technologies mostly employ Transformer-based encoder-decoder methods tailored for resource-rich languages. However, when training data is insufficient, Transformer-based methods perform poorly compared to CNN-based methods. Nonetheless, CNN-based methods cannot process global information and often fall short in capturing contextual information between characters. This paper proposes a Dual Feature Enhanced Scene Text Recognition Method based on the CNN encoder-decoder designed for low-resource Uyghur. In the encoder, we employ a dynamic attention enhancement technique to strengthen the model’s learning capability of features in both spatial and channel dimensions, reducing the model’s dependency on large-scale training data. In the decoder, we introduce a novel global feature enhancement strategy that associates features from the encoder globally, mitigating the convolutional neural network’s lack of global information processing ability. Additionally, we construct two Uyghur language scene datasets, named U1 and U2. Comparative experimental results demonstrate the outstanding performance of our method on the U1 and U2 datasets. Compared to baseline methods, our approach achieves a respective increase in accuracy of 5.2% and 3.2% while reducing model parameters.
This work was supported by the Joint Funds of the National Natural Science Foundation of China (Grant No. U1603262) and the National Natural Science Foundation of China (Grant No. 62137002), Shenzhen Municipal Science and Technology Innovation Committee Project (Grant No. GJGJZD20210408092806017).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Atienza, R.: Vision transformer for fast and efficient scene text recognition. In: International Conference on Document Analysis and Recognition. pp. 319–334. Springer (2021)
Baek, J., et al.: What is wrong with scene text recognition model comparisons? Dataset and model analysis. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (2019)
Bautista, D., Atienza, R.: Scene text recognition with permuted autoregressive sequence models. In: European Conference on Computer Vision, pp. 178–196. Springer (2022)
Borisyuk, F., Gordo, A., Sivakumar, V.: Rosetta: large scale system for text detection and recognition in images. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 71–79 (2018)
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale (2020). arXiv:2010.11929
Du, Y., et al.: Svtr: scene text recognition with a single visual model (2022). arXiv:2205.00159
Fang, S., Xie, H., Wang, Y., Mao, Z., Zhang, Y.: Read like humans: autonomous, bidirectional and iterative language modeling for scene text recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7098–7107 (2021)
Fujitake, M.: Dtrocr: decoder-only transformer for optical character recognition. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 8025–8035 (2024)
He, P., Huang, W., Qiao, Y., Loy, C., Tang, X.: Reading scene text in deep convolutional sequences. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30 (2016)
Ibrayim, M., Mattohti, A., Hamdulla, A.: An effective method for detection and recognition of Uyghur texts in images with backgrounds. Information 13(7), 332 (2022)
Ibrayim, M., Simayi, W., Hamdulla, A.: Unconstrained online handwritten Uyghur word recognition based on recurrent neural networks and connectionist temporal classification. Int. J. Biom. 13(1), 51–63 (2021)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization (2014). arXiv:1412.6980
Laroca, R., Cardoso, E.V., Lucio, D.R., Estevam, V., Menotti, D.: On the cross-dataset generalization in license plate recognition (2022). arXiv:2201.00267
Lee, C.Y., Osindero, S.: Recursive recurrent nets with attention modeling for ocr in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2231–2239 (2016)
Li, M., et al.: Trocr: transformer-based optical character recognition with pre-trained models. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, pp. 13094–13102 (2023)
Li, P., Zhu, J., Peng, L., Guo, Y.: Rnn based Uyghur text line recognition and its training strategy. In: 2016 12th IAPR Workshop on Document Analysis Systems (DAS), pp. 19–24. IEEE (2016)
Li, W., Mahpirat, Kang, W., Aysa, A., Ubul, K.: Multi-lingual hybrid handwritten signature recognition based on deep residual attention network. In: Biometric Recognition: 15th Chinese Conference, CCBR 2021, Shanghai, China, 10–12 Sept 2021, Proceedings 15, pp. 148–156. Springer (2021)
Li, W., Zhang, Y., Huang, Y., Shen, Y., Wang, Z.: A three-stage Uyghur recognition model combining the attention mechanism and different convolutional recurrent networks. Appl. Sci. 13(17), 9539 (2023)
Liu, X., Meng, G., Pan, C.: Scene text detection and recognition with advances in deep learning: a survey. Int. J. Doc. Anal. Recognit. (IJDAR) 22, 143–162 (2019)
Liu, Y., Kong, F., Xu, M., Silamu, W., Li, Y.: Scene Uyghur recognition based on visual prediction enhancement. Sensors 23(20), 8610 (2023)
Long, S., He, X., Yao, C.: Scene text detection and recognition: the deep learning era. Int. J. Comput. Vision 129, 161–184 (2021)
Rang, M., Bi, Z., Liu, C., Wang, Y., Han, K.: Large ocr model: An empirical study of scaling law for ocr (2023). arXiv:2401.00028
Shi, B., Bai, X., Yao, C.: An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(11), 2298–2304 (2016)
Tsai, S.S., Chen, H., Chen, D., Schroth, G., Grzeszczuk, R., Girod, B.: Mobile visual search on printed documents using text and low bit-rate features. In: 2011 18th IEEE International Conference on Image Processing, pp. 2601–2604. IEEE (2011)
Wang, P., Da, C., Yao, C.: Multi-granularity prediction for scene text recognition. In: European Conference on Computer Vision, pp. 339–355. Springer (2022)
Wang, Y., Ao, N., Guo, R., Mamat, H., Ubul, K.: Scene Uyghur recognition with embedded coordinate attention. In: 2022 3rd International Conference on Pattern Recognition and Machine Learning (PRML), pp. 253–260. IEEE (2022)
Wang, Z., Xie, H., Wang, Y., Xu, J., Zhang, B., Zhang, Y.: Symmetrical linguistic feature distillation with clip for scene text recognition. In: Proceedings of the 31st ACM International Conference on Multimedia, pp. 509–518 (2023)
Xamxidin, N., Mahpirat, Yao, Z., Aysa, A., Ubul, K.: Multilingual offline signature verification based on improved inverse discriminator network. Information 13(6), 293 (2022)
Ye, Q., Doermann, D.: Text detection and recognition in imagery: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 37(7), 1480–1500 (2014)
Zhang, C., et al.: Character-level street view text spotting based on deep multisegmentation network for smarter autonomous driving. IEEE Trans. Artif. Intell. 3(2), 297–308 (2021)
Zhao, S., Wang, X., Zhu, L., Yang, Y.: Clip4str: A simple baseline for scene text recognition with pre-trained vision-language model (2023). arXiv:2305.14014
Zheng, T., Chen, Z., Fang, S., Xie, H., Jiang, Y.G.: Cdistnet: perceiving multi-domain character distance for robust text recognition. Int. J. Comput. Vis. 1–19 (2023)
Zhu, Y., Yao, C., Bai, X.: Scene text detection and recognition: recent advances and future trends. Front. Comp. Sci. 10, 19–36 (2016)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Xu, M., Zhang, J., Xu, L., Li, Y., Silamu, W. (2025). Dual Feature Enhanced Scene Text Recognition Method for Low-Resource Uyghur. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2024. Lecture Notes in Computer Science, vol 15037. Springer, Singapore. https://doi.org/10.1007/978-981-97-8511-7_5
Download citation
DOI: https://doi.org/10.1007/978-981-97-8511-7_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-8510-0
Online ISBN: 978-981-97-8511-7
eBook Packages: Computer ScienceComputer Science (R0)