Research on Multi-units Control Method in RTS Games Based on PAGA

Abstract

Abstract: Unit control in real-time strategy games (RTS) is a challenging issue in the field of artificial intelligence (AI).Such games are constrained in real time,and have a large state and action space,which make intelligent algorithms do not solve this type of problem.By controlling the multi-units in the battle scene by searching strategy in the script space,it is possible to effectively overcome the adverse effects caused by the huge branching factor.This paper used adaptive genetic algorithm to search in scripting space to provid a good sequence of actions for multi-units in the battle scene and control the unit.Experiments show that the proposed PAGA (Portable Adaptive Genetic Algorithm) is feasible and effective,and its performance is superior to the current algorithms in large-scale unit control.

Key words: Adaptive genetic algorithm, AI, Multi-units control, RTS game

CLC Number:

TP273+.2

YANG Zhen, ZHANG Wan-peng, LIU Hong-fu, WEI Zhan-yang. Research on Multi-units Control Method in RTS Games Based on PAGA[J].Computer Science, 2018, 45(11A): 101-104.

References

[1]MISHRA K,SUGANDH N,RAM A.Case-Based Planning and Execution for Real-Time Strategy Games[C]∥International Conference on Case-Based Reasoning:Case-Based Reasoning Research and Development.Springer-Verlag,2007:164-178.
[2]SYNNAEVE G,BESSIERE P.A Bayesian Model for Opening Prediction in RTS Games with Application to StarCraft[J].Proceedings of IEEE Cig Seoul South Korea,2011,32(14):281-288.
[3]FOERSTER J,NARDELLI N,FARQUHAR G,et al.Stabili-sing Experience Replay for Deep Multi-Agent Reinforcement Learning[J].arXiv:1702.08887,2017.
[4]BARRIGA N A,STANESCU M,BURO M.Puppet Search:Enhancing Scripted Behavior by Look-Ahead Search with Applications to Real-Time Strategy Games[C]∥AIIDE.2015.
[5]CHURCHILL D,BURO M.Portfolio greedy search and simulation for large-scale combat in starcraft[C]∥Computational Intelligence in Games.IEEE,2013:1-8.
[6]JUSTESEN N,TILLMAN B,TOGELIUS J,et al.Script- and cluster-based UCT for StarCraft[C]∥Computational Intelligence and Games.IEEE,2014:1-8.
[7]WANG C,CHEN P,LI Y,et al.Portfolio online evolution in Star Craft[C]∥AAAI Conference on Artificial Intelligence and InteractiveDigital Entertainment.2016:114-120.
[8]USUNIER N,SYNNAEVE G,LIN Z,et al.Episodic Exploration for Deep Deterministic Policies:An Application to StarCraft Micromanagement Tasks[J].arXiv:1609.02993,2016.
[9]CHURCHILL D,BURO M.Portfolio greedy search and simulation for large-scale combat in starcraft[C]∥Computational Intelligence in Games.IEEE,2013:1-8.
[10]JUSTESEN N,RISI S.Continual online evolutionary planning for in-game build order adaptation in StarCraft[C]∥the Genetic and Evolutionary Computation Conference.2017:187-194.
[11]Holland J H.Adaptation in natural and artificial systems[M].MIT Press,1992.
[12]沐阿华,周绍磊,于晓丽.一种快速自适应遗传算法及其仿真研究[J].系统仿真学报,2004,16(1):122-125.
[13]姜昌华.遗传算法在物流系统优化中的应用研究[D].中山:华东师范大学,2007.
[14]SRINIVAS M,PATNAIKL M.Adaptive probabilities of crossover and mutation in genetic algorithms[J].IEEE Transactions on Systems Man & Cybernetics,2002,24(4):656-667.
[15]KOVARSKY A,BURO M.Heuristic Search Applied to Ab-stract Combat Games[M]∥Advances in Artificial Intelligence.Berlin:Springer,2005:66-78.

Related Articles 15

[1]	ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[2]	LENG Dian-dian, DU Peng, CHEN Jian-ting, XIANG Yang. Automated Container Terminal Oriented Travel Time Estimation of AGV [J]. Computer Science, 2022, 49(9): 208-214.
[3]	KONG Shi-ming, FENG Yong, ZHANG Jia-yun. Multi-level Inheritance Influence Calculation and Generalization Based on Knowledge Graph [J]. Computer Science, 2022, 49(9): 221-227.
[4]	FU Yan-ming, ZHU Jie-fu, JIANG Kan, HUANG Bao-hua, MENG Qing-wen, ZHOU Xing. Incentive Mechanism Based on Multi-constrained Worker Selection in Mobile Crowdsourcing [J]. Computer Science, 2022, 49(9): 275-282.
[5]	WANG Zi-kai, ZHU Jian, ZHANG Bo-jun, HU Kai. Research and Implementation of Parallel Method in Blockchain and Smart Contract [J]. Computer Science, 2022, 49(9): 312-317.
[6]	FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[7]	GUO Zheng-wei, FU Ze-wen, LI Ning, BAI Lan. Study on Acceleration Algorithm for Raw Data Simulation of High Resolution Squint Spotlight SAR [J]. Computer Science, 2022, 49(8): 178-183.
[8]	LI Yao, LI Tao, LI Qi-fan, LIANG Jia-rui, Ibegbu Nnamdi JULIAN, CHEN Jun-jie, GUO Hao. Construction and Multi-feature Fusion Classification Research Based on Multi-scale Sparse Brain Functional Hyper-network [J]. Computer Science, 2022, 49(8): 257-266.
[9]	HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[10]	XIONG Luo-geng, ZHENG Shang, ZOU Hai-tao, YU Hua-long, GAO Shang. Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism [J]. Computer Science, 2022, 49(7): 212-219.
[11]	WU Gong-xing, Sun Zhao-yang, JU Chun-hua. Closed-loop Supply Chain Network Design Model Considering Interruption Risk and Fuzzy Pricing [J]. Computer Science, 2022, 49(7): 220-225.
[12]	WU Su-jie, ZHOU Jie, WANG Xue-ying, LYU Zhi-kang, SHAO Gen-fu. Study on Characteristics of Millimeter-wave MIMO Channel in Rainfall Environment [J]. Computer Science, 2022, 49(7): 297-303.
[13]	GAO Ya, ZHAO Ning, LIU Wen-qi. Dependence Analysis Among Service Stations in Tandem Queueing Systems [J]. Computer Science, 2022, 49(7): 304-309.
[14]	ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
[15]	HUANG Pu, SHEN Yang-yang, DU Xu-ran, YANG Zhang-jing. Face Recognition Based on Locality Constrained Feature Line Representation [J]. Computer Science, 2022, 49(6A): 429-433.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!