Human-Human Interactional Synchrony Analysis Based on Body Sensor Networks
Pages 407 - 416
Abstract
Human-human interactions are widespread in many fields, but rarely investigated by using body sensor networks (BSNs). Due to the fact that distributed sensors can only provide local information, this paper proposes to analyse the interactional synchrony from both local and overall perspectives. The proposed framework analyses synchrony mainly including windowed cross-correlation, peak picking method and power average operator. Experiments conducted in this paper demonstrate that the proposed framework may not only distinguish between synchrony and asynchrony conditions, but also reveal different situations corresponding to different body parts.
References
[1]
Y. Inoue, et al., “Head motion synchronization in the process of consensus building,” in Proc. IEEE/SICE Int. Symp. Syst. Integr. Kobe Int. Conf. Center, 2013, pp. 70–75.
[2]
Z. Hammal, et al., “Temporal coordination of head motion in couples with history of interpersonal violence,” in Proc. 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recog., 2013, pp. 1–8.
[3]
P. Reddish, J. Bulbulia, and R. Fischer, “Does synchrony promote generalized prosociality?” Religion, Brain Behavior, vol. 4, no. 1, pp. 3–19, 2014.
[4]
P. Valdesolo, J. Ouyang, and D. DeSteno, “The rhythm of joint action: Synchrony promotes cooperative ability,” J. Experimental Soc. Psychology, vol. 46, no. 4, pp. 693–695, 2010.
[5]
W.-S. Chu, J. Zeng, F. D. la Torre, J. F. Cohn, and D. S. Messinger, “Unsupervised synchrony discovery in human interaction,” in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 3146–3154.
[6]
T. Lorenz, A. Mörtl, B. Vlaskamp, A. Schubö, and S. Hirche, “Synchronization in a goal-directed task: Human movement coordination with each other and robotic partners,” in Proc. RO-MAN, 20th IEEE Int. Symp. Robot Human Interactive Commun., 2011, pp. 198–203.
[7]
X. F. Sun, K. P. Truong, M. Pantic, and A. Nijholt, “Towards visual and vocal mimicry recognition in human-human interactions,” in Proc. IEEE Int. Conf. Syst. Man Cybern., 2011, pp. 367–373.
[8]
J. R. Terven, B. Raducanu, M. E. M. de Luna, and J. Salas, “Head-gestures mirroring detection in dyadic social interactions with computer vision-based wearable devices,” Neurocomputing, vol. 175, pp. 866–876, 2016.
[9]
E. Delaherche, M. Chetouani, A. Mahdhaoui, C. Saint-Georges, S. Viaux, and D. Cohen, “Interpersonal synchrony: A survey of evaluation methods across disciplines,” IEEE Tran. Affect. Comput., vol. 3, no. 3, pp. 349–365, Jul.–Sep. 2012.
[10]
R. C. Schmidt, S. Morr, P. Fitzpatrick, and M. J. Richardson, “Measuring the dynamics of interactional synchrony,” J. Nonverbal Behavior, vol. 36, no. 4, pp. 263–279, 2012.
[11]
W. Tschacher, G. M. Rees, and F. Ramseyer, “Nonverbal synchrony and affect in dyadic interactions,” Frontiers Psychology, vol. 5, pp. 1–13, 2014.
[12]
S. S. Wiltermuth and C. Heath, “Synchrony and cooperation,” Psychological Sci., vol. 20, no. 1, pp. 1–5, 2009.
[13]
H. Uchitomil, et al., “Interpersonal synchrony-based dynamic stabilization of the gait rhythm between human and virtual robot-clinical application to festinating gait of Parkinson's disease patient -,” in Proc. Int. Symp. Micro-NanoMechatronics Human Sci., 2012, pp. 460–465.
[14]
Z. Hammal, J. F. Cohn, and D. S. Messinger, “Head movement dynamics during play and perturbed mother-infant interaction,” IEEE Trans. Affect. Comput., vol. 6, no. 4, pp. 361–370, Oct.–Dec. 2015.
[15]
Y. Arimoto and K. Okanoya, “Emotional synchrony and covariation of behavioral/physiological reactions between interlocutors,” in Proc. 17th Oriental Chapter Int. Committeee Co-ordination Standardization Speech Databases Assessment Techn., 2014, pp. 1–6.
[16]
F. Ramseyer and W. Tschacher, “Nonverbal synchrony of head- and body-movement in psychotherapy: Different signals have different associations with outcome,” Frontiers Psychology, vol. 5, pp. 1–9, 2014.
[17]
I. H. López-Nava and A. Muñoz-Meléndez, “Wearable inertial sensors for human motion analysis: A review,” IEEE Sensors J., vol. 16, no. 22, pp. 7821–7834, Nov. 2016.
[18]
S. Qiu, Z. L. Wang, H. Y. Zhao, and H. S. Hu, “Using distributed wearable sensors to measure and evaluate human lower limb motions,” IEEE Trans. Instrum. Meas., vol. 65, no. 4, pp. 939–950, Apr. 2016.
[19]
G. Fortino, R. Giannantonio, R. Gravina, P. Kuryloski, and R. Jafari, “Enabling effective programming and flexible management of efficient body sensor network applications,” IEEE Trans. Human-Mach. Syst., vol. 43, no. 1, pp. 115–133, Jan. 2013.
[20]
Z. L. Wang, D. H. Wu, J. M. Chen, A. Ghoneim, and M. A. Hossain, “A triaxial accelerometer-based human activity recognition via EEMD-based features and game-theory-based feature selection,” IEEE Sensors J., vol. 16, no. 9, pp. 3198–3207, May. 2016.
[21]
A. Ahmadi, et al., “Automatic activity classification and movement assessment during a sports training session using wearable inertial sensors,” in Proc. 11th Int. Conf. Wearable Implantable Body Sensor Netw., 2014, pp. 98–103.
[22]
M. Caldara, et al., “A novel body sensor network for parkinson's disease patients rehabilitation assessment,” in Proc. 11th Int. Conf. Wearable Implantable Body Sensor Netw., 2014, pp. 81–86.
[23]
H. Ghasemzadeh, P. Panuccio, S. Trovato, G. Fortino, and R. Jafari, “Power-aware activity monitoring using distributed wearable sensors,” IEEE Trans. Human-Mach. Syst., vol. 44, no. 4, pp. 537–544, Aug. 2014.
[24]
Z. L. Wang, H. Y. Zhao, S. Qiu, and Q. Gao, “Stance-phase detection for zupt-aided foot-mounted pedestrian navigation system,” IEEE/ASME Trans. Mechatronics, vol. 20, no. 6, pp. 3170–3181, Dec. 2015.
[25]
R. Liu and M. Liu, “Recognizing human activities based on multi-sensors fusion,” in Proc. 4th Int. Conf. Bioinf. Biomed. Eng., 2010, pp. 1–4.
[26]
H. Zhao and Z. Y. Wang, “Motion measurement using inertial sensors, ultrasonic sensors, and magnetometers with extended kalman filter for data fusion,” IEEE Sensors J., vol. 12, no. 5, pp. 943–953, May. 2012.
[27]
W. A. Abdulhafiz and A. Khamis, “Bayesian approach to multisensor data fusion with pre-and post-filtering,” in Proc. 10th IEEE Int. Conf. Netw. Sens. Control, 2013, pp. 373–378.
[28]
M. Khodabandeh and A. Mohammad-Shahri, “Experimental study of uncertainty measures with sensor fusion techniques,” in Proc. 2nd Int. Asia Conf. Inf. Control Autom. Robot., 2010, pp. 151–154.
[29]
G. Fortino, S. Galzarano, R. Gravina, and W. Li, “A framework for collaborative computing and multi-sensor data fusion in body sensor networks,” Inf. Fusion, vol. 22, pp. 50–70, 2015.
[30]
B. Khaleghi, A. Khamis, F. O. Karray, and S. N. Razavi, “Multisensor data fusion: A review of the state-of-the-art,” Inf. Fusion, vol. 14, no. 1, pp. 28–44, 2013.
[31]
N. Yang, Z. L. Wang, and W. J. Hu, “Synchrony expression analysis of human-human interaction using wearable sensors,” in Proc. 12th IEEE Int. Conf. Control Autom., 2016, pp. 611–615.
[32]
A. Z. Zivotofsky and J. M. Hausdorff, “The sensory feedback mechanisms enabling couples to walk synchronously: An initial investigation,” J. Neuro Eng. Rehabil., vol. 4, no. 28, pp. 1–5, 2007.
[33]
D. Cesarini, G. Lelli, and M. Avvenuti, “Are we synchronized? measure synchrony in team sports using a network of wireless accelerometers,” in Proc. Int. Workshop Web Intell. Smart Sens., 2014, pp. 1–6.
[34]
S. M. Boker, M. Xu, J. L. Rotondo, and K. King, “Windowed cross-correlation and peak picking for the analysis of variability in the association between behavioral time series,” Psychological Methods, vol. 7, no. 1, pp. 338–355, 2002.
[35]
R. R. Yager, “The power average operator,” IEEE Trans. Syst. Man Cybern. Part A: Syst. Humans, vol. 31, no. 6, pp. 724–731, Nov. 2001.
[36]
R. R. Yager, “The power average operator for information fusion,” in Information Processing and Management of Uncertainty in Knowledge-based Systems: Applications, Part II, Berlin, Germany: Springer, 2010, pp. 208–220.
Index Terms
- Human-Human Interactional Synchrony Analysis Based on Body Sensor Networks
Index terms have been assigned to the content through auto-classification.
Recommendations
Body Movement Mirroring and Synchrony in Human–Robot Interaction
This review article provides an overview of papers that have studied body movement mirroring and synchrony within the field of human-robot interaction. The papers included in this review cover system studies, which focus on evaluating the technical ...
Eliciting interactional phenomena in human-human dialogues
SIGDIAL '09: Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and DialogueIn order to build a dialogue system that can interact with humans in the same way as humans interact with each other, it is important to be able to collect conversational data. This paper introduces a dialogue recording method where an eavesdropping ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
1949-3045 © 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications standards/publications/rights/index.html for more information.
Publisher
IEEE Computer Society Press
Washington, DC, United States
Publication History
Published: 01 July 2019
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Dec 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in