research-article

Scalable target detection for large robot teams

Authors:

Andreas Kolling,

Katia SycaraAuthors Info & Claims

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

Pages 363 - 370

https://doi.org/10.1145/1957656.1957792

Published: 06 March 2011 Publication History

Abstract

In this paper, we present an asynchronous display method, coined image queue, which allows operators to search through a large amount of data gathered by autonomous robot teams. We discuss and investigate the advantages of an asynchronous display for foraging tasks with emphasis on Urban Search and Rescue. The image queue approach mines video data to present the operator with a relevant and comprehensive view of the environment in order to identify targets of interest such as injured victims. It fills the gap for comprehensive and scalable displays to obtain a network-centric perspective for UGVs. We compared the image queue to a traditional synchronous display with live video feeds and found that the image queue reduces errors and operator's workload. Furthermore, it disentangles target detection from concurrent system operations and enables a call center approach to target detection. With such an approach we can scale up to very large multi-robot systems gathering huge amounts of data that is then distributed to multiple operators.

References

[1]

Olsen, D. and Wood, S. 2004. Fan-out: Measuring Human Control of Multiple Robots. In Proceedings of Human Factors in Computing Systems (CHI'04), Vienna, Austria: ACM Press, 231--238.

Digital Library

[2]

Crandall, J., Goodrich, M., Olsen, D. and Nielsen, C. 2005. Validating human-robot interaction schemes in multitasking environments. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 35(4), 438--449.

Digital Library

[3]

Miller, C. and Parasuraman, R. 2007. Designing for flexible interaction between humans and automation: Delegation interfaces for supervisory control. Human Factors 49(1), 57--75.

[4]

Scerri, P., Liao, E., Lai, L., Sycara, K., Xu, Y. and Lewis, M. 2005. Coordinating very large groups of wide area search munitions. Theory and Algorithms for Cooperative Systems, World Scientific, 451--480.

[5]

Kira, Z. and Potter, M. 2010. Exerting Human Control Over Decentralized Robot Swarms. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS'10, 566--571.

[6]

McLurkin, J., Smith, J., Frankel, J., Sotkowitz, D., Blau, D. and Schmidt, B. 2006. Speaking Swarmish: Human-Robot Interface Design for Large Swarms of Autonomous Mobile Robots. In Proceedings of AAAI Spring Symposium.

[7]

Ding, X., Powers, M., Egerstedt, M., Young, S. and Balch, T. 2009. Executive Decision Support: Single-Agent Control of Multiple UAVs. IEEE Robotics & Automation Magazine, 16 (2), 73--81.

[8]

Cooke, N., Pringle, H., Pedersen, H. and Connor, O. (Ed.) 2006. Human Factors of Remotely Operated Vehicles. Amsterdam, NL: Elsevier.

[9]

Humphrey, C., Henk, C., Sewell, G., Williams, B. and Adams, J. 2007. "Assessing the Scalability of a Multiple Robot Interface," In Proceedings of the 2nd ACM/IEEE International Conference on Human-Robotic Interaction (HRI'07), 239--246.

Digital Library

[10]

Lewis, M., Wang, H., Chien, S., Velagapudi, P., Scerri, P. and Sycara, K. 2010. Choosing autonomy modes for multirobot search, Human Factors, 52(2), 225--233.

[11]

Draper, M. H., Calhoun, G. L., Nelson, J. T. and Ruff, H. A. 2006. Evaluation of synthetic vision overlay concepts for UAV sensor operations: landmark cues and picture-in-picture. In Proceedings of the Human Factors and Ergonomic Society 50th Annual Meeting, 121--125.

[12]

Hunn, B. 2005. The Human Challenges of Command and Control with Multiple Unmanned Aerial Vehicles. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting, 20--24(5).

[13]

Gugerty, L. and Brooks, J. 2001. Seeing Where You Are Heading: Integrating Environmental and Egocentric Reference Frames in Cardinal Direction Judgements. Journal of Experimental Psychology: Applied, 7 (3), 251--66.

[14]

Alberts, D., Garstka, J. and Stein, F. 1999. Network-centric Warfare: Developing and leveraging information superiority, the Command and Control Research Program.

[15]

UE3 http://www.unreal.com/technology.php, accessed September 15, 2010.

[16]

Carpin, S., Stoyanov, T., Nevatia, Y., Lewis, M. and Wang, J. 2006. Quantitative assessments of USARSim accuracy. In Proceedings of PerMIS.

[17]

Carpin, S., Wang, J., Lewis, M., Birk, A., and Jacoff, A. 2006. High fidelity tools for rescue robotics: Results and perspectives, Robocup 2005: Robot Soccer World Cup IX, Springer LNAI vol 4020, Springer, 301--311.

Digital Library

[18]

PhysX, http://www.nvidia.com/object/physx_new.html, accessed September 15, 2010.

[19]

Carpin, S., Lewis, M., Wang, J., Balakirsky, S. and Scrapper, C. 2006b. Bridging the gap between simulation and reality in urban search and rescue. Robocup 2006: Robot Soccer World Cup X, Springer, Lecture Notes in Artificial Intelligence, 1--12.

Digital Library

[20]

Lewis, M., Hughes, S., Wang, J., Koes, M. and Carpin, S. 2005. Validating USARsim for use in HRI research, In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, Orlando, FL, 2005, 457--461.

[21]

Pepper, C., Balakirsky, S. and Scrapper, C. 2007. Robot Simulation Physics Validation, In Proceedings of PerMIS'07.

Digital Library

[22]

Taylor, B., Balakirsky, S., Messina, E. and Quinn, R. 2007. Design and Validation of a Whegs Robot in USARSim, In Proceedings of PerMIS'07.

Digital Library

[23]

Zaratti, M., Fratarcangeli, M and Iocchi, L. 2006. A 3D Simulator of Multiple Legged Robots based on USARSim. Robocup 2006: Robot Soccer World Cup X, Springer, LNAI, 13--24.

Digital Library

[24]

Balakirsky, S., Carpin, S., Kleiner, A., Lewis, M., Visser, A., Wang, J., and Zipara, V. 2007. Toward hetereogeneous robot teams for disaster mitigation: Results and performance metrics. RoboCup Rescue, Journal of Field Robotics, 24(11-12), 943--967.

Digital Library

[25]

Chien, S., Wang, H, and Lewis, M. (2010). Human vs. algorithmic path planning for search and rescue by robot teams, In Proceedings of the 54th Annual Meeting of the Human Factors and Ergonomics Society (HFES'10), 379--383.

[26]

Robocup Rescue VR http://www.robocuprescue.org/wiki/index.php?title=VRCompetitions#Singapore_2010, accessed September 15, 2010

[27]

Hart, S., and Staveland, L. 1988. Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload, Amsterdam, The Netherlands: Elsevier, 139--183.

[28]

Velagapudi, P., Wang, J., Wang, H., Scerri, P., Lewis, M., and Sycara, K. 2008. Synchronous vs. Asynchronous Video in Multi-Robot Search, In Proceedings of first International Conference on Advances in Computer-Human Interaction. (ACHI'08), 224--229.

Digital Library

[29]

Velagapudi, P., Wang, H., Scerri, P., Lewis, M. and Sycara, K. 2009. Scaling effects for streaming video vs. static panorama in multirobot search, In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS'09, 5874--5879.

Digital Library

Cited By

Kim SAnthis JSebo SGrollman DBroadbent EJu WSoh HWilliams T(2024)A Taxonomy of Robot Autonomy for Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634993(381-393)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634993
Ray HSinger RAhmed N(2022)A Review of the Operational Use of UAS in Public Safety Emergency Incidents2022 International Conference on Unmanned Aircraft Systems (ICUAS)10.1109/ICUAS54217.2022.9836061(922-931)Online publication date: 21-Jun-2022
https://doi.org/10.1109/ICUAS54217.2022.9836061
Amir ODoshi-Velez FSarne D(2019)Summarizing agent strategiesAutonomous Agents and Multi-Agent Systems10.1007/s10458-019-09418-wOnline publication date: 26-Jul-2019
https://doi.org/10.1007/s10458-019-09418-w
Show More Cited By

Index Terms

Scalable target detection for large robot teams
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. External interfaces for robotics

Recommendations

Towards human control of robot swarms
HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

In this paper we investigate principles of swarm control that enable a human operator to exert influence on and control large swarms of robots. We present two principles, coined selection and beacon control, that differ with respect to their temporal ...
How search and its subtasks scale in N robots
HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction

The present study investigates the effect of the number of controlled robots on performance of an urban search and rescue (USAR) task using a realistic simulation. Participants controlled either 4, 8, or 12 robots. In the fulltask control condition ...
Synchronous vs. asynchronous control for large robot teams
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II

In this paper, we discuss and investigate the advantages of an asynchronous display, called image queue, for foraging tasks with emphasis on Urban Search and Rescue. The image queue approach mines video data to present the operator with a relevant and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

March 2011

526 pages

ISBN:9781450305617

DOI:10.1145/1957656

General Chairs:
Aude Billard
EPFL, Switzerland
,
Peter Kahn
University of Washington, USA
,
Program Chairs:
Julie A. Adams
Vanderbilt University, USA
,
Greg Trafton
US Naval Research Laboratories, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

RA: IEEE Robotics and Automation Society
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc
The Association for the Advancement of Artificial Intelligence (AAAI)
IEEE Systems, Man and Cybernetics Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI'11

Sponsor:

HRI'11: International Conference on Human-Robot Interaction

March 6 - 9, 2011

Lausanne, Switzerland

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
313
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim SAnthis JSebo SGrollman DBroadbent EJu WSoh HWilliams T(2024)A Taxonomy of Robot Autonomy for Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634993(381-393)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634993
Ray HSinger RAhmed N(2022)A Review of the Operational Use of UAS in Public Safety Emergency Incidents2022 International Conference on Unmanned Aircraft Systems (ICUAS)10.1109/ICUAS54217.2022.9836061(922-931)Online publication date: 21-Jun-2022
https://doi.org/10.1109/ICUAS54217.2022.9836061
Amir ODoshi-Velez FSarne D(2019)Summarizing agent strategiesAutonomous Agents and Multi-Agent Systems10.1007/s10458-019-09418-wOnline publication date: 26-Jul-2019
https://doi.org/10.1007/s10458-019-09418-w
Amir ODoshi-Velez FSarne DAndre EKoenig SDastani MSukthankar G(2018)Agent Strategy SummarizationProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237877(1203-1207)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237877
Li ALuo WNagavalli SSycara K(2017)Decentralized coordinated motion for a large team of robots preserving connectivity and avoiding collisions2017 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA.2017.7989180(1505-1511)Online publication date: May-2017
https://doi.org/10.1109/ICRA.2017.7989180
Lee PYou PHuang YHsieh Y(2017)Inconsistency detection and data fusion in USAR taskEngineering Computations10.1108/EC-11-2015-033934:1(18-32)Online publication date: 6-Mar-2017
https://doi.org/10.1108/EC-11-2015-0339
Lee PZadorozhny V(2016)Information Fusion Using Characteristic Linear System in Multi-robot Search and Rescue Task2016 IEEE 17th International Conference on Information Reuse and Integration (IRI)10.1109/IRI.2016.59(394-400)Online publication date: Jul-2016
https://doi.org/10.1109/IRI.2016.59
Ahmed NCampbell MCasbeer DCao YKingston DBayen ABranicky M(2015)Fully bayesian learning and spatial reasoning with flexible human sensor networksProceedings of the ACM/IEEE Sixth International Conference on Cyber-Physical Systems10.1145/2735960.2735970(80-89)Online publication date: 14-Apr-2015
https://dl.acm.org/doi/10.1145/2735960.2735970
Kosti SKaminka GSarne DBazzan AHuhns MLomuscio AScerri P(2014)Towards effective user-guided robot search (extended abstract)Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems10.5555/2615731.2617500(1415-1416)Online publication date: 5-May-2014
https://dl.acm.org/doi/10.5555/2615731.2617500
Zadorozhny VLewis M(2014)Fusing Information, Crowdsourcing and MobilityProceedings of the 2014 IEEE 15th International Conference on Mobile Data Management - Volume 0210.1109/MDM.2014.77(4-6)Online publication date: 14-Jul-2014
https://dl.acm.org/doi/10.1109/MDM.2014.77
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents