Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

NGUARD+: An Attention-based Game Bot Detection Framework via Player Behavior Sequences

Published: 28 September 2020 Publication History

Abstract

Game bots are automated programs that assist cheating users, leading to an imbalance in the game ecosystem and the collapse of user interest. Online games provide immersive gaming experience and attract many loyal fans. However, game bots have proliferated in volume and method, evolving with the real-world detection methods and showing strong diversity, leaving game bot detection efforts extremely difficult. Existing game bot detection techniques mostly rely on handcrafted features or time-series based features instead of fully utilizing player behavior sequences. In this regard, a more reasonable way should be learning user patterns from player behavior sequences when facing the fast-changing nature of game bots. Here we propose a general game bot detection framework for massively multiplayer online role playing games termed NGUARD+ (denoting NetEase Games’ Guard), which captures user patterns in order to identify game bots from player behavior sequences. NGUARD+ mainly employs attention-based methods to automatically differentiate game bots from humans. We provide a combination of supervised and unsupervised methods for game bot detection to detect game bots and new type of game bots even when the labels of game bots are limited. Specifically, we propose the following two variants for attention-based sequence modeling: Attention based Bidirectional Long Short-Term Memory Networks (ABLSTM) and Hierarchical Self-Attention Network (HSAN) as our supervised models. ABLSTM is keen on inducing certain inductive biases which makes learning more reasonable as well as capturing local dependency and global information, while HSAN could handle much longer behavior sequences with less memory and higher computational efficiency. Experiments conducted on a real-world dataset show that NGUARD+ can achieve remarkable performance improvement compared to traditional methods. Moreover, NGUARD+ can reveal outstanding robustness for game bots in mutated patterns and even in completely unseen patterns.

References

[1]
M. A. Ahmad, B. Keegan, J. Srivastava, D. Williams, and N. Contractor. 2009. Mining for gold farmers: Automatic detection of deviant players in MMOGs. In Proceedings of the 12th International Conference on Computational Science and Engineering.
[2]
Amr Ahmed, Kai Yu, Wei Xu, Yihong Gong, and Eric Xing. 2008. Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks. In Proceedings of the 10th European Conference on Computer Vision.
[3]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the 3rd International Conference on Learning Representations.
[4]
Mario Luca Bernardi, Marta Cimitile, Fabio Martinelli, and Francesco Mercaldo. 2017. A time series classification approach to game bot detection. In Proceedings of the 7th International Conference on Web Intelligence, Mining and Semantics. ACM.
[5]
Kuan-Ta Chen, Jhih-Wei Jiang, Polly Huang, Hao-Hua Chu, Chin-Laung Lei, and Wen-Chin Chen. 2009. Identifying MMORPG bots: A traffic analysis approach. EURASIP Journal on Advances in Signal Processing (2009), 797159.
[6]
Kuan-Ta Chen, Hsing-Kuo Kenneth Pao, and Hong-Chung Chang. 2008. Game bot identification based on manifold learning. In Proceedings of the 7th ACM SIGCOMM Workshop on Network and System Support for Games. ACM.
[7]
YeonJun Choi, SungJune Chang, YongJun Kim, HunJoo Lee, WookHo Son, and SeongIl Jin. 2016. Detecting and monitoring game bots based on large-scale user-behavior log data analysis in multiplayer online games. The Journal of Supercomputing 72, 9 (2016), 3572--3587.
[8]
Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research 12 (2011), 2493--2537.
[9]
Andrew M. Dai and Quoc V. Le. 2015. Semi-supervised sequence learning. In Proceedings of the 29th International Conference on Neural Information Processing Systems. Curran Associates, Inc.
[10]
Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, and Lukasz Kaiser. 2019. Universal transformers. In Proceedings of the 7th International Conference on Learning Representations.
[11]
Jeffrey L. Elman. 1990. Finding structure in time. Cognitive Science 14, 2 (1990), 179--21.
[12]
Martin Ester, Hans-Peter Kriegel, Jörg Sander, and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 226--231.
[13]
Wensheng Gan, Jerry Chun-Wei Lin, Philippe Fournier-Viger, Han-Chieh Chao, and Philip S. Yu. 2019. A survey of parallel sequential pattern mining. ACM Transactions on Knowledge Discovery from Data 13, 3 (2019), 1--34.
[14]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. PMLR, 249--256.
[15]
Philippe Golle and Nicolas Ducheneaut. 2005. Preventing bots from playing online games. Computers in Entertainment 3, 3 (2005), 3--3.
[16]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep residual learning for image recognition. In Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition. 770--778.
[17]
Sylvain Hilaire, Hyun chul Kim, and Chong kwon Kim. 2010. How to deal with bot scum in MMORPGs? In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability.
[18]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735--1780.
[19]
Adele Lu Jia, Siqi Shen, Ruud Van De Bovenkamp, Alexandru Iosup, Fernando Kuipers, and Dick H. J. Epema. 2015. Socializing by gaming: Revealing social relationships in multiplayer online games. ACM Transactions on Knowledge Discovery from Data 10, 2 (2015), 1--29.
[20]
Michael I. Jordan. 1986. Attractor dynamics and parallelism in a connectionist sequential machine. In Proceedings of the 8th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum, 531--546.
[21]
Ah Reum Kang, Seong Hoon Jeong, Aziz Mohaisen, and Huy Kang Kim. 2016. Multimodal game bot detection using user behavioral characteristics. SpringerPlus 26, 5 (2016), 523.
[22]
Hyungil Kim, Sungwoo Hong, and Juntae Kim. 2005. Detection of auto programs for MMORPGs. In Proceedings of the 18th Australian Joint Conference on Advances in Artificial Intelligence.
[23]
Yoon Kim, Carl Denton, Luong Hoang, and Alexander M. Rush. 2017. Structured attention networks. In Proceedings of the 5th International Conference on Learning Representations.
[24]
Hyukmin Kwon, Aziz Mohaisen, Jiyoung Woo, Yongdae Kim, Eunjo Lee, and Huy Kang Kim. 2017. Crime scene reconstruction: Online gold farming network analysis. IEEE Transactions on Information Forensics and Security 12, 3 (2017), 544–556.
[25]
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 11 (1998), 2278–2324.
[26]
Eunjo Lee, Jiyoung Woo, Hyoungshick Kim, Aziz Mohaisen, and Huy Kang Kim. 2016. You are a game bot! Uncovering game bots in MMORPGs via self-similarity in the wild. In Proceedings of Network and Distributed System Security Symposium.
[27]
Jina Lee, Jiyoun Lim, Wonjun Cho, and Huy Kang Kim. 2015. In-game action sequence analysis for game BOT detection on the big data analysis platform. In Proceedings of the 18th Asia Pacific Symposium on Intelligent and Evolutionary Systems. Springer International Publishing.
[28]
Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the 14th Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1412--1421.
[29]
Qiang Ma, Shan Muthu Muthukrishnan, and William Simpson. 2016. App2Vec: Vector modeling of mobile apps and applications. In Proceedings of the 6th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining.
[30]
Maxime Oquab, Leon Bottou, Ivan Laptev, and Josef Sivic. 2014. Learning and transferring mid-level image representations using convolutional neural networks. In Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society.
[31]
Sinno Jialin Pan and Qiang Yang. 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22, 10 (2010), 1345–1359.
[32]
Christian Platzer. 2011. Sequence-based bot detection in massive multiplayer online games. In Proceedings of the 8th International Conference on Information, Communications Signal Processing.
[33]
Jordan B. Pollack. 1991. The induction of dynamical recognizers. Machine Learning 7, 2–3 (1991), 227--252.
[34]
Kusno Prasetya and Zheng da Wu. 2010. Artificial neural network for bot detection system in MMOGs. In Proceedings of the 9th Annual Workshop on Network and Systems Support for Games. IEEE Press.
[35]
J. Schmidhuber, F. Gers, and D. Eck. 2002. Learning nonregular languages: A comparison of simple recurrent networks and LSTM. Neural Computation 14, 19 (2002), 2039–2041.
[36]
M. Schuster and K. K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing 45, 11 (1997), 2673–2681.
[37]
Tao Shen, Tianyi Zhou, Guodong Long, Jing Jiang, Shirui Pan, and Chengqi Zhang. 2018. DiSAN: Directional self-attention network for RNN/CNN-free language understanding. In Proceedings of the 32th AAAI Conference on Artificial Intelligence.
[38]
Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems. Curran Associates, Inc.
[39]
Jianrong Tao, Jiarong Xu, Linxia Gong, Yifu Li, Changjie Fan, and Zhou Zhao. 2018. NGUARD: A game bot detection framework for NetEase MMORPGs. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’18). ACM, New York, NY, 811--820.
[40]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc.
[41]
Ronald J. Williams and David Zipser. 1989. A learning algorithm for continually running fully recurrent neural networks. Neural Computation 1, 2 (1989), 270–280.
[42]
Jiyoung Woo and Huy Kang Kim. 2012. Survey and research direction on online game security. In Proceedings of the 39th International Conference Workshop at SIGGRAPH Asia. ACM.
[43]
Kyungmoon Woo, Hyukmin Kwon, Hyun-chul Kim, Chong-kwon Kim, and Huy Kang Kim. 2011. What can free money tell us on the virtual black market?. In Proceedings of the 11th ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. ACM.
[44]
Roman V. Yampolskiy and Venu Govindaraju. 2008. Embedded noninteractive continuous bot detection. Computers in Entertainment 5, 4 (2008), 1--11.

Cited By

View all
  • (2024)Performance evaluation of lightweight network-based bot detection using mouse movementsEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108801135(108801)Online publication date: Sep-2024
  • (2023)The Influence of Herd Mentality on Rating Bias and Popularity Bias: A Bi-Process Debiasing Recommendation Model Based on Matrix FactorizationBehavioral Sciences10.3390/bs1301006313:1(63)Online publication date: 10-Jan-2023
  • (2023)PU-Detector: A PU Learning-based Framework for Real Money Trading Detection in MMORPGACM Transactions on Knowledge Discovery from Data10.1145/363856118:4(1-26)Online publication date: 29-Dec-2023
  • Show More Cited By

Index Terms

  1. NGUARD+: An Attention-based Game Bot Detection Framework via Player Behavior Sequences

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Knowledge Discovery from Data
      ACM Transactions on Knowledge Discovery from Data  Volume 14, Issue 6
      December 2020
      376 pages
      ISSN:1556-4681
      EISSN:1556-472X
      DOI:10.1145/3427188
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 September 2020
      Accepted: 01 May 2020
      Received: 01 January 2020
      Published in TKDD Volume 14, Issue 6

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Game bot detection
      2. attention mechanism
      3. auto-iteration mechanism
      4. sequence modeling
      5. transfer learning

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      • National Key R8D Program of China
      • Zhejiang Natural Science Foundation
      • National Natural Science Foundation of China

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)76
      • Downloads (Last 6 weeks)10
      Reflects downloads up to 01 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Performance evaluation of lightweight network-based bot detection using mouse movementsEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108801135(108801)Online publication date: Sep-2024
      • (2023)The Influence of Herd Mentality on Rating Bias and Popularity Bias: A Bi-Process Debiasing Recommendation Model Based on Matrix FactorizationBehavioral Sciences10.3390/bs1301006313:1(63)Online publication date: 10-Jan-2023
      • (2023)PU-Detector: A PU Learning-based Framework for Real Money Trading Detection in MMORPGACM Transactions on Knowledge Discovery from Data10.1145/363856118:4(1-26)Online publication date: 29-Dec-2023
      • (2023)KnowSite: Leveraging Urban Knowledge Graph for Site SelectionProceedings of the 31st ACM International Conference on Advances in Geographic Information Systems10.1145/3589132.3625640(1-12)Online publication date: 13-Nov-2023
      • (2023)Cheating in eSports: Problems and Challenges2023 IEEE Gaming, Entertainment, and Media Conference (GEM)10.1109/GEM59776.2023.10390156(1-6)Online publication date: 19-Nov-2023
      • (2023)Deep learning applications in games: a survey from a data perspectiveApplied Intelligence10.1007/s10489-023-05094-253:24(31129-31164)Online publication date: 1-Dec-2023
      • (2023)Automatic Personality Prediction Based on Users’ Chinese Handwriting ChangeComputer Supported Cooperative Work and Social Computing10.1007/978-981-99-2385-4_33(435-449)Online publication date: 13-May-2023
      • (2022)Quick and easy game bot detection based on action time interval estimationETRI Journal10.4218/etrij.2022-0089Online publication date: 4-Dec-2022
      • (2022)Multiagent-Based Data Presentation Mechanism for Multifaceted Analysis in Network Management TasksSensors10.3390/s2222884122:22(8841)Online publication date: 15-Nov-2022
      • (2022)Effective Bots’ Detection for Online Smartphone Game Using Multilayer Perceptron Neural NetworksSecurity and Communication Networks10.1155/2022/94294752022Online publication date: 1-Jan-2022
      • Show More Cited By

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media