research-article

Architecture of a cyberphysical avatar

Authors:

Aloysius K. Mok,

Risto MiikkulainenAuthors Info & Claims

ICCPS '13: Proceedings of the ACM/IEEE 4th International Conference on Cyber-Physical Systems

Pages 189 - 198

https://doi.org/10.1145/2502524.2502550

Published: 08 April 2013 Publication History

Abstract

This paper introduces the concept of a cyberphysical avatar which is defined to be a semi-autonomous robotic system that adjusts to an unstructured environment and performs physical tasks subject to critical timing constraints while under human supervision. Cyberphysical avatar integrates the recent advance in three technologies: body-compliant control in robotics, neuroevolution in machine learning and QoS guarantees in real-time communication. Body-compliant control is essential for operator safety since cyberphysical avatars perform cooperative tasks in close proximity to humans. Neuroevolution technique is essential for "programming" cyberphysical avatars inasmuch as they are to be used by non-experts for a large array of tasks, some unforeseen, in an unstructured environment. QoS-guaranteed real-time communication is essential to provide predictable, bounded-time response in human-avatar interaction. By integrating these technologies, we have built a prototype cyberphysical avatar testbed.

References

[1]

Song Han, Aloysius K. Mok, Jianyong Meng, Yi-Hung Wei, Pei-Chi Huang, Xiuming Zhu, Luis Sentis, Kwan Suk Kim, Risto Miikkulainen, and Jacob Menashe, "Architecture of a cyberphysical avatar," to appear in International Workshop on Real-Time and Distributed Computing in Emerging Applications (REACTION 2012).

[2]

L. Sentis, Motion Planning for Humanoid robots, chapter Compliant Control of Whole-Body Multi-Contact Behaviors in Humanoid Robots, pp. 29--63, Springer Berlin Heidelberg, 2010.

[3]

L. Sentis, J. Park, and O. Khatib, "Compliant control of multi-contact and center of mass behaviors in humanoid robots," IEEE Transactions on Robotics, vol. 26, no. 3, pp. 483--501, June 2010.

Digital Library

[4]

Risto Miikkulainen, "Neuroevolution," in Encyclopedia of Machine Learning. 2010.

[5]

Simon S. Haykin, Neural Networks and Learning Machines, Prentice Hall, Upper Saddle River, New Jersey, third edition, 2009.

[6]

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, MIT Press, Cambridge, MA, 1998.

Digital Library

[7]

Kenneth O. Stanley and Risto Miikkulainen, "Evolving neural networks through augmenting topologies," Evolutionary Computation, vol. 10, no. 2, pp. 99--127, 2002.

Digital Library

[8]

Song Han, Aloysius K. Mok, Jianyong Meng, Yi-Hung Wei, Xiuming Zhu, Luis Sentis, Kwan Suk Kim, Risto Miikkulainen, and Jacob Menashe, "Architecture of a cyberphysical avatar," UTCS Technical Report #TR-12-12. http://apps.cs.utexas.edu/tech_reports/reports/tr/TR-2082.pdf.

[9]

Matei Ciocarlie, Columbia University," http://sourceforge.net/projects/graspit/files/releases/.

[10]

Nick Jakobi, Minimal Simulations for Evolutionary Robotics, Ph.D. thesis, School of Cognitive and Computing Sciences, University of Sussex, 1998.

[11]

Hod Lipson, Josh Bongard, Victor Zykov, and Evan Malone, "Evolutionary robotics for legged machines: From simulation to physical reality," in Proceedings of the 9th International Conference on Intelligent Autonomous Systems., 2006, pp. 11--18.

[12]

Faustino Gomez and Risto Miikkulainen, "Transfer of neuroevolved controllers in unstable domains," in Proceedings of the Genetic and Evolutionary Computation Conference, Berlin, 2004, Springer.

[13]

Vinod Valsalam, Utilizing Symmetry in Evolutionary Design, Ph.D. thesis, Department of Computer Sciences, The University of Texas at Austin, 2010, Technical Report AI-10-04.

[14]

Sylvain Koos, Jean-Baptiste Mouret, and Stéphane Doncieux, "Crossing the reality gap in evolutionary robotics by promoting transferable controllers," in Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation, New York, NY, USA, 2010, pp. 119--126, ACM.

Digital Library

[15]

Orazio Miglino, Henrik Hautop Lund, and Stefano Nolfi, "Evolving mobile robots in simulated and real environments," Artificial Life, vol. 2, pp. 417--434, 1995.

Digital Library

[16]

Juan Cristóbal Zagal and Javier Ruiz-Del-Solar, "Combining simulation and reality in evolutionary robotics," Journal of Intelligent and Robotic Systems, vol. 50, pp. 19--39, 2007.

Digital Library

[17]

S. Bak, D. K. Chivukula, O. Adekunle, Mu Sun, M. Caccamo, and Lui Sha, "The system-level simplex architecture for improved real-time embedded system safety," in Real-Time and Embedded Technology and Applications Symposium, 2009. RTAS 2009. 15th IEEE, april 2009, pp. 99--107.

Digital Library

[18]

"IEEE 802.15.4 WPAN Task Group," www.ieee802.org/15/pub/TG4.html.

[19]

"WirelessHART," http://www.hartcomm.org/protocol/wihart/wireless_technology.html.

[20]

Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner, "Openflow: enabling innovation in campus networks," SIGCOMM Comput. Commun. Rev., 2008.

Digital Library

[21]

"Openkinect," www.openkinect.org.

[22]

Geoffrey G. Xie and Simon S. Lam, "Delay guarantee of virtual clock server," IEEE/ACM Trans. Netw., 1995.

Digital Library

[23]

Pawan Goyal, Simon Lam, and Harrick Vin, "Determining end-to-end delay bounds in heterogeneous networks," Network and Operating Systems Support for Digital Audio and Video Springer Berlin/Heidelberg, vol. 1018, pp. 273--284, 1995.

Digital Library

[24]

"Indigo open source firmware for openflow swiches," http://www.openflowhub.org/display/Indigo/.

[25]

"Floodlight openflow controller," http://floodlight.openflowhub.org/.

[26]

Jianping Song, Song Han, Al Mok, Deji Chen, Mike Lucas, Mark Nixon, and Wally Pratt, "WirelessHART: Applying wireless technology in real-time industrial process control," in Proc. of IEEE RTAS, 2008.

Digital Library

[27]

"Avatar Demo," http://www.cs.utexas.edu/~shan/avatar.html.

[28]

F. Lima J. G. Petersen K. S. Kim L. Sentis P. D. Wong, S. Gupta, "Building an educational whole-body compliant mobile humanoid robot for safe rough-terrain physical hri," in IEEE International Conference on Intelligent Robots and Systems (under submission), 2012.

Cited By

Jiménez Sánchez ÁLavín JMartín García N(2024)Personajes y avatares femeninos en los videojuegos subyacentes a la narrativa fílmica: evolución, roles y transgresiones.Investigaciones Feministas10.5209/infe.8762414:2(205-213)Online publication date: 5-Dec-2024
https://doi.org/10.5209/infe.87624
Zhou QLi GChen QLi J(2021)Guaranteeing Timely Response to Changes of Monitored Objects by Assigning Deadlines and Periods to TasksACM Transactions on Embedded Computing Systems10.1145/347702720:5s(1-22)Online publication date: 22-Sep-2021
https://dl.acm.org/doi/10.1145/3477027
Deng CLi GZhou QLi J(2020)Guarantee the Quality-of-Service of Control Transactions in Real-Time Database SystemsIEEE Access10.1109/ACCESS.2020.30023358(110511-110522)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3002335
Show More Cited By

Index Terms

Architecture of a cyberphysical avatar

Recommendations

Investigating the impacts of avatar gender, avatar age, and region theme on avatar physical activity in the virtual world

This study proposed a research model to examine the impacts of avatar gender, avatar age, and location (region theme) on avatars' physical activity. Each construct was measured at two levels: male and female for avatar gender, young and old for avatar ...
Video Avatar: Embedded Video for Collaborative Virtual Environment
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

This paper proposes the video avatar, the avatar with the embedded video of the human body in the collaborative virtual environment. The video avatar enables the visual communication between the avatars. The video avatar has three features for enhancing ...
Video Avatar: Embedded Video for Collaborative Virtual Environment
ICMCS '99: Proceedings of the 1999 IEEE International Conference on Multimedia Computing and Systems - Volume 02

This paper proposes the video avatar, the avatar with the embedded video of the human body in the collaborative virtual environment. The video avatar enables the visual communication between the avatars. The video avatar has three features for enhancing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICCPS '13: Proceedings of the ACM/IEEE 4th International Conference on Cyber-Physical Systems

April 2013

278 pages

ISBN:9781450319966

DOI:10.1145/2502524

General Chair:
Chenyang Lu
Washington University
,
Program Chairs:
P. R. Kumar
Texas A&M University
,
R. Stoleru
Texas A&M University

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IEEE-CS\TCRT: TC on Real-Time Systems
SIGBED: ACM Special Interest Group on Embedded Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

ICCPS '13

Sponsor:

IEEE-CS\TCRT
SIGBED

ICCPS '13: ACM/IEEE 4th International Conference on Cyber-Physical Systems

April 8 - 11, 2013

Pennsylvania, Philadelphia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
236
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jiménez Sánchez ÁLavín JMartín García N(2024)Personajes y avatares femeninos en los videojuegos subyacentes a la narrativa fílmica: evolución, roles y transgresiones.Investigaciones Feministas10.5209/infe.8762414:2(205-213)Online publication date: 5-Dec-2024
https://doi.org/10.5209/infe.87624
Zhou QLi GChen QLi J(2021)Guaranteeing Timely Response to Changes of Monitored Objects by Assigning Deadlines and Periods to TasksACM Transactions on Embedded Computing Systems10.1145/347702720:5s(1-22)Online publication date: 22-Sep-2021
https://dl.acm.org/doi/10.1145/3477027
Deng CLi GZhou QLi J(2020)Guarantee the Quality-of-Service of Control Transactions in Real-Time Database SystemsIEEE Access10.1109/ACCESS.2020.30023358(110511-110522)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3002335
Leng QChen WHuang PWei YMok AHan S(2019)Network Management of Multicluster RT-WiFi NetworksACM Transactions on Sensor Networks10.1145/328345115:1(1-26)Online publication date: 10-Feb-2019
https://dl.acm.org/doi/10.1145/3283451
Li GZhou CLi JGuo B(2019)Maintaining Data Freshness in Distributed Cyber-Physical SystemsIEEE Transactions on Computers10.1109/TC.2018.288945668:7(1077-1090)Online publication date: 1-Jul-2019
https://doi.org/10.1109/TC.2018.2889456
Tramarin FMok AHan S(2019)Real-Time and Reliable Industrial Control Over Wireless LANs: Algorithms, Protocols, and Future DirectionsProceedings of the IEEE10.1109/JPROC.2019.2913450107:6(1027-1052)Online publication date: Jun-2019
https://doi.org/10.1109/JPROC.2019.2913450
Deng CLi GZhou QLi J(2019)Co-Scheduling of Hybrid Transactions on Multiprocessor Real-Time Database SystemsIEEE Access10.1109/ACCESS.2019.29327997(109506-109517)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2932799
Betiol Júnior JCosta RMoraes RRech LVasques F(2019)RT-WiFi Approach to Handle Real-Time Communication: An Experimental EvaluationAd-Hoc, Mobile, and Wireless Networks10.1007/978-3-030-31831-4_20(290-303)Online publication date: 25-Sep-2019
https://doi.org/10.1007/978-3-030-31831-4_20
Wei YLeng QChen WMok AHan S(2018)Schedule Adaptation for Ensuring Reliability in RT-WiFi-Based Networked Embedded SystemsACM Transactions on Embedded Computing Systems10.1145/323601117:5(1-23)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1145/3236011
Huang PSentis LLehman JFok CMok AMiikkulainen R(2018)Tradeoffs in Neuroevolutionary Learning-Based Real-Time Robotic Task Design in the Imprecise Computation FrameworkACM Transactions on Cyber-Physical Systems10.1145/31789033:2(1-29)Online publication date: 10-Oct-2018
https://dl.acm.org/doi/10.1145/3178903
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten