Abstract
In this paper, we propose an algorithm for detection and recognition of all information fields at the bank card front side based on video sequences. The algorithm is intended for use on mobile devices. This algorithm consists of the following basic steps: detection of the card boundaries in a frame, segmenting the information fields, improving the quality of segments, localizing the boundaries of symbols, and recognizing blocks of symbols. We also conduct a series of experiments. Experimental results show that our algorithm can achieve higher detection rates of 88% for all information fields and 92.5% for the bank card number and expiration date. The processing time per frame at different resolutions for each step by using iPhone 7 is presented. The experimental results confirm the efficiency of the proposed approach.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.REFERENCES
Sheshkus, A., Nikolaev, D., Ingacheva, A., and Skoryukina, N., Approach to the recognition of flexible forms on the example of the credit card date recognition, Proc. 8th Int. Conf. Machine Vision (ICMV), Barcelona, 2015, pp. 83–88.
Christian, T. and Gustavsson, D., Content recognition of business cards, IT Univ. Copenhagen, 2007.
Mollah, A., Basu, S., Das, N., Sarkar, R., Nasipuri, M., and Kundu, M., Text region extraction from business card images for mobile devices, Proc. Int. Conf. Information Technology and Business Intelligence (ITBI), Nagpur, India, 2009, pp. 227–235.
Bhaskar, S., Lavassar, N., and Green, S., Implementing on the Android operating system for business cards, Stanford Univ., 2010, pp. 1–5.
Sharma, P. and Fujii, K., Automatic contact importer from business cards for Android, Stanford Univ., 2013.
Hua, G., Liu, Z., Zhang, Z., and Wu, Y., Automatic business card scanning with a camera, Proc. Int. Conf. Image Processing, Atlanta, 2006, pp. 373–376.
Cai, S., Wen, J., Xu, H., Chen, S., and Ming, Z., Bank card and ID card number recognition in Android financial APP, Lect. Notes Comput. Sci., 2017, vol. 10135, pp. 205–213.
Liu, L., Huang, L., and Xue, J., Identification of serial number on bank card using recurrent neural network, Proc. 9th Int. Conf. Graphic and Image Processing (ICGIP), Qingdao, China, 2017, pp. 319–325.
Arlazarov, V.V., Bulatov, K.B., and Karpenko, S.M., Method for determining the reliability of embossed character recognition, Tr. Inst. Sist. Anal. Ross. Akad. Nauk (Proc. Inst. Syst. Anal. Russ. Acad. Sci.), 2013, vol. 63, no. 3, pp. 117–122.
Puybareau, E. and Geraud, T., Real-time document detection in smartphone videos, Proc. 24th IEEE Int. Conf. Image Processing (ICIP), France, 2018, pp. 1498–1502.
Viola, P. and Jones, M., Rapid object detection using a boosted cascade of simple features, Proc. IEEE Comput. Soc. Conf. Computer Vision and Pattern Recognition, Kauai, USA, 2001, pp. 511–519.
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y., OverFeat: Integrated recognition, localization and detection using convolutional networks, Proc. Int. Conf. Learning Representations (ICLR), Banff, Canada, 2014, pp. 1055–1061.
OpenCV documentation, Image filtering. https://docs. opencv.org/2.4/modules/imgproc/doc/filtering.html# getgaussiankernel.
Mason, S.J. and Graham, N.E., Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation, Q. J. R. Meteorol. Soc., 2002, vol. 128, pp. 2145–2166.
CardIO official website. https://www.card.io.
Funding
This work was supported by the Public Welfare Technology Applied Research Program of the Zhejiang Province (LGF19F020016, LGJ18F020001, and LGJ19F020002) and the National High-End Foreign Experts Program (GDW20183300463).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Translated by Yu. Kornienko
Rights and permissions
About this article
Cite this article
Chen, H., Ye, S., Kurilovich, A. et al. Video-Based Content Recognition of Bank Cards with Mobile Devices. Program Comput Soft 46, 373–383 (2020). https://doi.org/10.1134/S036176882006002X
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S036176882006002X