research-article

Enhancing automated red teaming with evolvable simulation

Authors:

Malcolm Yoke Hean Low,

Chwee Seng ChooAuthors Info & Claims

GEC '09: Proceedings of the first ACM/SIGEVO Summit on Genetic and Evolutionary Computation

Pages 687 - 694

https://doi.org/10.1145/1543834.1543928

Published: 12 June 2009 Publication History

Abstract

Automated Red Teaming (ART), an automated process for Manual Red Teaming, is a technique frequently utilised by the Military Operational Analysis (OA) community to uncover vulnerabilities in operational tactics. Currently, individual ART studies are limited to the parameter tuning of a simulation model with a fixed structure. The effects in the evolutions of structural features of a simulation model have not been investigated in any of the studies. This paper investigates the benefits of Evolvable Simulation, which involves evolution of the structure of a simulation model. The case study used for this purpose is a maritime based scenario which involves the defense of an anchorage. Simulation results obtained through Evolvable Simulation revealed that the quality of the solutions found given an appropriate amount of evaluations will improve when the simulation model is evolved. Additionally, experimental results also showed that it is likely to have negligible improvement in solutions for models with smaller search space when the amount of evaluations is more than required. The insights obtained in this work shows that evolvable simulation is an effective methodology which allows decision makers to enhance their understanding on military operational tactics.

References

[1]

P. Barry and M. Koehler. Simulation in context: using data farming for decision support. In WSC '04: Proceedings of the 36th conference on Winter simulation, pages 814--819. Winter Simulation Conference, 2004.

Digital Library

[2]

C. S. Choo, C. L. Chua, and S.-H. V. Tay. Automated red teaming: a proposed framework for military application. In GECCO '07: Proceedings of the 9th annual conference on Genetic and evolutionary computation, pages 1936--1942, New York, NY, USA, 2007. ACM.

Digital Library

[3]

C. A. Coello Coello and M. S. Lechuga. Mopso: a proposal for multiple objective particle swarm optimization. In Proc. Congress on Evolutionary Computation CEC '02, volume 2, pages 1051--1056, 12--17 May 2002.

Digital Library

[4]

J. M. de la Cruz, E. Besada-Portas, L. Torre-Cubillo, B. Andres-Toro, and J. A. Lopez-Orozco. Evolutionary path planner for uavs in realistic environments. In GECCO '08: Proceedings of the 10th annual conference on Genetic and evolutionary computation, pages 1477--1484, New York, NY, USA, 2008. ACM.

Digital Library

[5]

K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. A fast and elitist multiobjective genetic algorithm: NSGA-II. Evolutionary Computation, IEEE Transactions on, 6(2):182--197, 2002.

Digital Library

[6]

R. Eberhart and J. Kennedy. A new optimizer using particle swarm theory. In Proc. Sixth International Symposium on Micro Machine and Human Science MHS '95, pages 39--43, 4--6 Oct. 1995.

[7]

H. Friman and G. E. Horne. Using agent models and data farming to explore network centric operations. In WSC '05: Proceedings of the 37th conference on Winter simulation, pages 1094--1100. Winter Simulation Conference, 2005.

Digital Library

[8]

D. P. Galligan, M. A. Anderson, and M. K. Lauren. Map Aware Non--uniform Automata Version 3.0. Operations Analysis Section, Defence Technology Agency, New Zealand, April 2005.

[9]

G. E. Home and T. E.Meyer. Data farming: discovering surprise. In WSC '05: Proceedings of the 37th conference on Winter simulation, pages 1082--1087. Winter Simulation Conference, 2005.

Digital Library

[10]

J. Kennedy and R. Eberhart. Particle swarm optimization. Neural Networks, 1995. Proceedings., IEEE International Conference on, 4:1942--1948 vol.4, Nov/Dec 1995.

[11]

J. Kennedy, R. C. Eberhart, and Y. Shi. Swarm intelligence. Morgan Kaufmann Publishers Inc, 2001.

Digital Library

[12]

M. Lee, D. Ang, and L. F. Hung. Team 7: Applying automated red teaming in an urban ops scenario. In Scythe 1: Proceedings and Bulletin of the International Data Farming Community, pages 24--30, Montery, CA, USA, 2006. Naval Postgraduate School.

[13]

K.-H. Liang and K.-M. Wang. Using simulation and evolutionary algorithms to evaluate the design of mix strategies of decoy and jammers in anti-torpedo tactics. In WSC '06: Proceedings of the 38th conference on Winter simulation, pages 1299--1306. Winter Simulation Conference, 2006.

Digital Library

[14]

M. Litzkow, M. Livny, and M. Mutka. Condor-a hunter of idle workstations. In Distributed Computing Systems, 1988., 8th International Conference on, pages 104--111, 1988.

[15]

T. W. Lucas, S. M. Sanchez, F. Martinez, L. R. Sickinger, and J. W. Roginski. Defense and homeland security applications of multi-agent simulations. In WSC '07: Proceedings of the 39th conference on Winter simulation, pages 138--149, Piscataway, NJ, USA, 2007. IEEE Press.

Digital Library

[16]

S. Mittal and K. Deb. Three-dimensional offline path planning for uavs using multiobjective evolutionary algorithms. In Proc. IEEE Congress on Evolutionary Computation CEC 2007, pages 3195--3202, 25--28 Sept. 2007.

[17]

K. E. Parsopoulos and M. N. Vrahatis. Particle swarm optimization method in multiobjective problems. In SAC '02: Proceedings of the 2002 ACM symposium on Applied computing, pages 603--607, New York, NY, USA, 2002. ACM.

Digital Library

[18]

J. P. Ridder and J. C. HandUber. Mission planning for joint suppression of enemy air defenses using a genetic algorithm. In GECCO '05: Proceedings of the 2005 conference on Genetic and evolutionary computation, pages 1929--1936, New York, NY, USA, 2005. ACM.

Digital Library

[19]

B. Rosenberg, M. Richards, J. T. Langton, S. Tenenbaum, and D. W. Stouch. Applications of multiobjective evolutionary algorithms to air operations mission planning. In GECCO '08: Proceedings of the 2008 GECCO conference companion on Genetic and evolutionary computation, pages 1879--1886, New York, NY, USA, 2008. ACM.

Digital Library

[20]

W. C. Sim, C. S. Choo, F. M-Tiburcio, K. Lin, and M. Shee. Team 7: Applying automated red teaming in a maritime scenario. In Scythe 2: Proceedings and Bulletin of the International Data Farming Community, pages 26--29, Montery, CA, USA, 2006. Naval Postgraduate School.

[21]

P. Tripathi, S. Bandyopadhyay, and S. Pal. Multi-Objective Particle Swarm Optimization with time variant inertia and acceleration coefficients. Information Sciences, 177(22):5033--5049, 2007.

[22]

D. J. Walton, E. P. Paulo, C. J. McCarthy, and R. Vaidyanathan. Modeling force response to small boat attack against high value commercial ships. In WSC '05: Proceedings of the 37th conference on Winter simulation, pages 988--991. Winter Simulation Conference, 2005.

Digital Library

[23]

A. C. H. Wong, C. L. Chua, Y. K. Lim, S. C. Kang, C. L. J. Teo, T. Lampe, P. Hingston, and B. Abbott. Team 1: Applying automated red teaming in a maritime scenario. In Scythe 3: Proceedings and Bulletin of the International Data Farming Community, pages 3--5, Montery, CA, USA, 2007. Naval Postgraduate School.

[24]

E. Zitzler, M. Laumanns, L. Thiele, et al. SPEA2: Improving the Strength Pareto Evolutionary Algorithm. In EUROGEN, pages 95--100, 2001

Cited By

Ranjeet THingston PLam CMasek M(2011)Analysis of key installation protection using computerized red teamingProceedings of the Thirty-Fourth Australasian Computer Science Conference - Volume 11310.5555/2459296.2459312(137-144)Online publication date: 17-Jan-2011
https://dl.acm.org/doi/10.5555/2459296.2459312
Decraene JZeng FLow MCai WCheng YChoo CKropf P(2011)Evolutionary design of experiments using the MapReduce frameworkProceedings of the 2011 Summer Computer Simulation Conference10.5555/2348196.2348207(76-83)Online publication date: 27-Jun-2011
https://dl.acm.org/doi/10.5555/2348196.2348207
Hingston PPreuss M(2011)Red teaming with coevolution2011 IEEE Congress of Evolutionary Computation (CEC)10.1109/CEC.2011.5949747(1155-1163)Online publication date: Jun-2011
https://doi.org/10.1109/CEC.2011.5949747
Show More Cited By

Index Terms

Enhancing automated red teaming with evolvable simulation
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
    2. Simulation evaluation

Recommendations

Research advances in automated red teaming
SpringSim '10: Proceedings of the 2010 Spring Simulation Multiconference

We present, combine and apply novel research advances to Automated Red Teaming (ART). ART is an automated vulnerability assessment tool which is employed to uncover the hard-to-predict and potentially critical elements of military operations. ART is ...
Automated red teaming: a proposed framework for military application
GECCO '07: Proceedings of the 9th annual conference on Genetic and evolutionary computation

In this paper, we describe Automated Red Teaming (ART), a concept that uses Evolutionary Algorithm (EA), Parallel Computing and Simulation to complement the manual Red Teaming effort to uncover system vulnerabilities or to find exploitable gaps in ...
Evolvable simulations applied to automated red teaming: a preliminary study
WSC '10: Proceedings of the Winter Simulation Conference

We report preliminary studies on evolvable simulations applied to Automated Red Teaming (ART). ART is a vulnerability assessment tool in which agent-based models of simplified military scenarios are repeatedly and automatically generated, executed and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

GEC '09: Proceedings of the first ACM/SIGEVO Summit on Genetic and Evolutionary Computation

June 2009

1112 pages

ISBN:9781605583266

DOI:10.1145/1543834

General Chairs:
Lihong Xu
Tongji University, China
,
Erik D. Goodman
Michigan State University, USA
,
Program Chairs:
Guoliang Chen
University of Sci. & Tech. of China
,
Darrell Whitley
Colorado State University, USA
,
Yongsheng Ding
Donghua University, China

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

GEC '09

Sponsor:

GEC '09: GEC '09 - ACM/SIGEVO Genetic and Evolutionary Computation Summit

June 12 - 14, 2009

Shanghai, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
266
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ranjeet THingston PLam CMasek M(2011)Analysis of key installation protection using computerized red teamingProceedings of the Thirty-Fourth Australasian Computer Science Conference - Volume 11310.5555/2459296.2459312(137-144)Online publication date: 17-Jan-2011
https://dl.acm.org/doi/10.5555/2459296.2459312
Decraene JZeng FLow MCai WCheng YChoo CKropf P(2011)Evolutionary design of experiments using the MapReduce frameworkProceedings of the 2011 Summer Computer Simulation Conference10.5555/2348196.2348207(76-83)Online publication date: 27-Jun-2011
https://dl.acm.org/doi/10.5555/2348196.2348207
Hingston PPreuss M(2011)Red teaming with coevolution2011 IEEE Congress of Evolutionary Computation (CEC)10.1109/CEC.2011.5949747(1155-1163)Online publication date: Jun-2011
https://doi.org/10.1109/CEC.2011.5949747
Decraene JChandramohan MLow MChoo CYücesan E(2010)Evolvable simulations applied to automated red teamingProceedings of the Winter Simulation Conference10.5555/2433508.2433685(1444-1455)Online publication date: 5-Dec-2010
https://dl.acm.org/doi/10.5555/2433508.2433685
Decraene JChandramohan MLow MChoo C(2010)Evolvable simulations applied to Automated Red Teaming: A preliminary studyProceedings of the 2010 Winter Simulation Conference10.1109/WSC.2010.5679047(1444-1455)Online publication date: Dec-2010
https://doi.org/10.1109/WSC.2010.5679047
Decraene JLow MZeng FZhou SCai W(2010)Automated modeling and analysis of agent-based simulations using the CASE framework2010 11th International Conference on Control Automation Robotics & Vision10.1109/ICARCV.2010.5707764(346-351)Online publication date: Dec-2010
https://doi.org/10.1109/ICARCV.2010.5707764
Hingston PPreuss MSpierling D(2010)RedTNet: A network model for strategy gamesIEEE Congress on Evolutionary Computation10.1109/CEC.2010.5586505(1-9)Online publication date: Jul-2010
https://doi.org/10.1109/CEC.2010.5586505

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents