REINFORCEMENT LEARNING BASED ANTI-COLLISION ALGORITHM FOR RFID SYSTEMS
DOI:
https://doi.org/10.47839/ijc.18.2.1414Keywords:
collision avoidance, dynamic frame-slotted Aloha, EPC-C1G2, reinforcement learning, Q-learning.Abstract
Efficient collision arbitration protocol facilitates fast tag identification in radio frequency identification (RFID) systems. EPCGlobal-Class1-Generation2 (EPC-C1G2) protocol is the current standard for collision arbitration in commercial RFID systems. However, the main drawback of this protocol is that it requires excessive message exchanges between tags and the reader for its operation. This wastes energy of the already resource-constrained RFID readers. Hence, in this work, reinforcement learning based anti-collision protocol (RL-DFSA) is proposed to address the energy efficient collision arbitration problem in the RFID system. The proposed algorithm continuously learns and adapts to the changes in the environment by devising an optimal policy. The proposed RL-DFSA was evaluated through extensive simulations and compared with the variants of EPC-C1G2 algorithms that are currently being used in the commercial readers. Based on the results, it is concluded that RL-DFSA performs equal or better than EPC-C1G2 protocol in delay, throughput and time system efficiency when simulated for sparse and dense environments while requiring one order of magnitude lesser control message exchanges between the reader and the tags.References
K. Finkenzeller, RFID Handbook: Fundamentals and Applications in Contactless Smart Cards, Radio Frequency Identification and near-Field Communication, Third Edition. Wiley, 2010.
R. Want, “Enabling ubiquitous sensing with RFID,” Computer (Long. Beach. Calif)., vol. 37, no. 4, pp. 84–86, 2004.
S. Ahson, RFID Handbook: Applications, Technology, Security, and Privacy. 2008.
D.J. Deng and H.W. Tsao, “Optimal dynamic framed slotted ALOHA based anti-collision algorithm for RFID systems,” Wirel. Pers. Commun., vol. 59, no. 1, pp. 109–122, 2011.
C.H. Liao, T.K. Woo, C.C. Chen, and I.J. Su, “A novel grouping slotted Aloha scheme to enhance throughput performance for wireless networks,” Wirel. Pers. Commun., vol. 96, no. 1, pp. 1229–1243, 2017.
Y.I. Joo, D.H. Seo, and J.W. Kim, “An efficient anti-collision protocol for fast identification of RFID tags,” Wirel. Pers. Commun., vol. 77, no. 1, pp. 767–775, 2014.
Y. Chu, P.D. Mitchell, and D. Grace, “ALOHA and Q-Learning based medium access control for wireless sensor networks,” Proceedings of the 2012 Int. Symp. Wirel. Commun. Syst., 2012, pp. 511–515.
F.C. Schoute, “Dynamic frame length ALOHA,” IEEE Trans. Commun., vol. 31, no. 4, pp. 565–568, 1983.
EPCglobal, Specification for RFID Air Interface EPC TM Radio-Frequency Identity Protocols Class-1 Generation-2 UHF RFID, 2008.
S. Dhakal and S. Shin, “Precise-optimal frame length based collision reduction schemes for frame slotted Aloha RFID systems,” KSII Trans. Internet Inf. Syst., vol. 8, no. 1, pp. 165–182, 2014.
C. Floerkemeier, “Transmission control scheme for fast RFID object identification,” Proceedings of the Fourth Annual IEEE International Conference on Pervasive Comput. Commun. Work. PerCom Work. 2006, vol. 2006, pp. 457–462, 2006.
M.V. Bueno-Delgado and J. Vales-Alonso, “On the optimal frame-length configuration on real passive RFID systems,” J. Netw. Comput. Appl., vol. 34, no. 3, pp. 864–876, 2011.
B. Zhen, M. Kobayashi, and M. Shimizu, “Framed ALOHA for multiple RFID objects identification,” IEICE Trans. Commun., vol. E88–B, no. 3, pp. 991–999, 2005.
J.B. Eom and T.J. Lee, “Accurate tag estimation for dynamic framed-slotted ALOHA in RFID systems,” IEEE Commun. Lett., vol. 14, no. 1, pp. 60–62, 2010.
W.T. Chen, “A fast anticollision algorithm for the EPCglobal UHF class-1 generation-2 RFID standard,” IEEE Commun. Lett., vol. 18, no. 9, pp. 1519–1522, 2014.
G. Shaheen, RFID Tag Identification Protocol Implementing Threshold-Based Dynamic Framed Slotted Aloha Policy, Carleton University, 2010.
L. Matignon, G.J. Laurent, and N. Le Fort-Piat, “Reward function and initial values: Better choices for accelerated goal-directed reinforcement learning,” Artif. Neural Networks - ICANN 2006, Pt 1, vol. 4131, pp. 840–849, 2006.
L. Zhenzhen and E. Itamar, “RL-MAC: A QoS-aware reinforcement learning based MAC protocol for wireless sensor networks,” Int. J. Sens. Networks, vol. 1, no. 3, pp. 117–124, 2006.
K.-L.A. Yau, H.G. Goh, D. Chieng, and K.H. Kwong, “Application of reinforcement learning to wireless sensor networks: models and algorithms,” Computing, vol. 97, no. 11. pp. 1045-1075, 2015.
GAORFID, “Android Based UHF Gen 2 RFID Handheld Data Terminal 246029.” pp. 1–3, 2018.
Rapidradio, “UHF Handheld Reader RRUHFHH2.” pp. 1–2, 2018.
M. Ghavamzadeh, H. J. Kappen, M. G. Azar, and R. Munos, “Speedy Q-Learning,” Adv. Neural Inf. Process. Syst., pp. 2411–2419, 2011.
P. Šolić, J. Radić, and N. Rožić, “Energy efficient tag estimation method for ALOHA-Based RFID Systems,” IEEE Sens. J., vol. 14, no. 10, pp. 3637–3647, 2014.
P. Šolić, M. Šarić, and M. Stella, “RFID reader-tag communication throughput analysis using Gen2 Q-algorithm frame adaptation scheme,” Int. J. Circuits, Syst. Signal Process., vol. 8, pp. 233-239, 2014.
J. Wang, D. Wang, Y. Zhao, and T. Korhonen, “Fast anti-collision algorithms in RFID systems,” Proceedings of the Int. Conf. Mob. Ubiquitous Comput. Syst. Serv. Technol. UBICOMM 2007, pp. 75–80, 2007.
D. Klair, K. W. Chin, and R. Raad, “On the energy consumption of pure and slotted Aloha based RFID anti-collision protocols,” Comput. Commun., vol. 32, no. 5, pp. 961–973, 2009.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.