Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Detection of nodding of interlocutors using a chair-shaped device and investigating relationship between a divergent thinking task and amount of nodding

  • Research Article
  • Published:
Quality and User Experience Aims and scope Submit manuscript

Abstract

We evaluate a group’s intellectual productivity in terms of its nodding. We first propose a method that detects nodding using a chair-shaped sensing device: SenseChair. Normalized time series of 3D data (i.e., the center-of-gravity [X, Y] and weight changes [W] on the seat) were submitted to a short-time frequency analysis with a Hanning window function. Nodding was detected by a neural network using the obtained short-time frequency data as features. We confirmed that this method’s accuracy was comparable to that of an existing one that uses cameras. Next 13 groups of six speakers were engaged in a divergent thinking task where their nodding was detected by our proposed method. The results showed that the amount of nodding increased after idea generation, suggesting a positive relationship between the amount of nodding and the group’s intellectual productivity. However, we found no significant correlation between the quality of each subjectively rated idea and the amount of nodding (i.e., the idea-level correlation). Therefore, we can conclude that our method was successful in detecting nodding from the seated participants as a behavior with functions of local coordination and agreement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Aburumman N, Gillies M, Ward JA et al (2022) Nonverbal communication in virtual reality: Nodding as a social signal in virtual interactions. Int J Hum Comput Stud 164:102819. https://doi.org/10.1016/j.ijhcs.2022.102819

    Article  Google Scholar 

  2. Baltruvsaitis T, Robinson P, Morency LP (2016) Openface: an open source facial behavior analysis toolkit. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp 1–10, https://doi.org/10.1109/WACV.2016.7477553

  3. Briñol P, Petty RE (2003) Overt head movements and persuasion: a self-validation analysis. J Pers Soc Psychol 84(6):1123

    Article  Google Scholar 

  4. Fujiwara K, Kimura M, Daibo I (2019) Gender differences in synchrony: females in sync during unstructured dyadic conversation. Eur J Soc Psychol 49(5):1042–1054. https://doi.org/10.1002/ejsp.2587

    Article  Google Scholar 

  5. Fujiwara K, Kimura M, Daibo I (2020) Rhythmic features of movement synchrony for bonding individuals in dyadic interaction. J Nonverbal Behav 44(1):173–193. https://doi.org/10.1007/s10919-019-00315-0

    Article  Google Scholar 

  6. Gifford R, Ng CF, Wilkinson M (1985) Nonverbal cues in the employment interview: links between applicant qualities and interviewer judgments. J Appl Psychol 70:729–736. https://doi.org/10.1037/0021-9010.70.4.729

    Article  Google Scholar 

  7. Guilford J (1967) The nature of human intelligence. The nature of human intelligence, McGraw-Hill, New York, NY, US

    Google Scholar 

  8. Hale J, Ward JA, Buccheri F et al (2020) Are you on my wavelength? interpersonal coordination in dyadic conversations. J Nonverbal Behav 44(1):63–83. https://doi.org/10.1007/s10919-019-00320-3

    Article  Google Scholar 

  9. Hall J (1971) Decisions, decisions, decisions. Psychol Today 5(1):51–54

    MathSciNet  Google Scholar 

  10. Hennessey BA, Amabile TM (2010) Creativity. Annu Rev Psychol 61(1):569–598. https://doi.org/10.1146/annurev.psych.093008.10041

    Article  Google Scholar 

  11. Itoh M (2008) Human monitoring-based driving support. IFAC Proceedings Volumes 41(2):15076–15087. , 17th IFAC World Congresshttps://doi.org/10.3182/20080706-5-KR-1001.02551

  12. Jindai M, Nakamura K, Watanabe T (2016) A nodding detection system based on the active appearance model. J Adv Mech Des Syst Manuf. https://doi.org/10.1299/jamdsm.2016jamdsm0021

    Article  Google Scholar 

  13. Kennedy L, Ellis D (2003) Pitch-based emphasis detection for characterization of meeting recordings. In: 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721), pp 243–248, https://doi.org/10.1109/ASRU.2003.1318448

  14. Kihara H, Fukushima S, Naemura T (2016) Analysis of human nodding behavior during group work for designing nodding robots. In: Proceedings of the 2016 ACM international conference on supporting group work. association for computing machinery, New York, NY, USA, GROUP ’16, pp 433-436, https://doi.org/10.1145/2957276.2996287

  15. Kita S, Ide S (2007) Nodding, aizuchi, and final particles in japanese conversation: How conversation reflects the ideology of communication and social relationships. J Pragmat 39(7):1242–1254. https://doi.org/10.1016/j.pragma.2007.02.009

    Article  Google Scholar 

  16. Kogure M (2007) Nodding and smiling in silence during the loop sequence of backchannels in japanese conversation. Journal of Pragmatics 39(7):1275–1289. , nodding, Aizuchi, and Final Particles in Japanese Conversation https://doi.org/10.1016/j.pragma.2007.02.011

  17. Matarazzo JD, Saslow G, Wiens AN, et al (1964) Interviewer head nodding and interviewee speech durations. Psychotherapy: Theory, Research & Practice 1:54–63. , place: US Publisher: Division of Psychotherapy (29), American Psychological Association https://doi.org/10.1037/h0088571

  18. Matsui Y, Hikono M (2018) Relationship between performance and physical synchrony of the members in small group discussion: Focusing on high-synchrony groups. Ergonomics (in Japanese) 54(Supplement):2C2–4

  19. Maynard S (1989) Japanese Conversation: Self-contextualization Through Structure and Interactional Management. Advances in discourse processes, Ablex Pub

    Google Scholar 

  20. McGovern TV, Jones BW, Morris SE (1979) Comparison of professional versus student ratings of job interviewee behavior. J Counseling Psychol 26:176–179. https://doi.org/10.1037/0022-0167.26.2.176

    Article  Google Scholar 

  21. Mutlu B, Krause A, Forlizzi J, et al (2007) Robust, low-cost, non-intrusive sensing and recognition of seated postures. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, UIST ’07, p 149-158, https://doi.org/10.1145/1294211.1294237

  22. Olguin-Olguin D, Pentland A (2010) Sensor-based organisational design and engineering. Int J Organ Des Eng 1(1–2):69–97. https://doi.org/10.1504/IJODE.2010.035187

    Article  Google Scholar 

  23. Oshima S (2014) Achieving consensus through professionalized head nods: the role of nodding in service encounters in japan. Int J Bus Commun 51:31–57. https://doi.org/10.1177/2329488413516207

    Article  Google Scholar 

  24. Otsuka K, Sawada H, Yamato J (2007) Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances. In: Proceedings of the 9th International Conference on Multimodal Interfaces. Association for Computing Machinery, New York, NY, USA, ICMI ’07, p 255-262, https://doi.org/10.1145/1322192.1322237

  25. Plucker JA, Karwowski M, Kaufman JC (2020) Intelligence and Creativity, 2nd edn., Cambridge University Press, Cambridge Handbooks in Psychology, pp 1087-1105

  26. Sakamoto K, Shimizu Y, Mito K et al (2009) Tremor and vibratory perception in a living body - Functional evaluation of mechanical vibration -. Tokyo Denki University Press, Toyko, Japan

    Google Scholar 

  27. Sharma M, Ahmetovic D, Jeni LA, et al (2018) Recognizing visual signatures of spontaneous head gestures. In: 2018 IEEE Winter conference on applications of computer vision (WACV), pp 400–408, https://doi.org/10.1109/WACV.2018.00050

  28. Stiefelhagen R, Yang J, Waibel A (2002) Modeling focus of attention for meeting indexing based on multiple cues. IEEE Trans Neural Netw 13(4):928–938. https://doi.org/10.1109/TNN.2002.1021893

    Article  Google Scholar 

  29. Sumi Y, Yano M, Nishida T (2010) Analysis environment of conversational structure with nonverbal multimodal data. In: international conference on multimodal interfaces and the workshop on machine learning for multimodal interaction. Association for Computing Machinery, New York, NY, USA, ICMI-MLMI ’10, https://doi.org/10.1145/1891903.1891958

  30. Tan H, Slivovsky L, Pentland A (2001) A sensing chair using pressure distribution sensors. IEEE/ASME Trans Mechatron 6(3):261–268. https://doi.org/10.1109/3516.951364

    Article  Google Scholar 

  31. Tsuzuki T, Itoh Y, Fujiwara K et al (2017) A method for sensing synchrony between communicating persons by sensechair and the evaluation toward conversation. Trans Human Interface Soc (in Japanese) 19(2):151–162

    Google Scholar 

  32. Vanhala T, Surakka V, Anttonen J (2008) Measuring bodily responses to virtual faces with a pressure sensitive chair. In: Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. Association for Computing Machinery, New York, NY, USA, NordiCHI ’08, p 555-559, https://doi.org/10.1145/1463160.1463243, https://doi.org/10.1145/1463160.1463243

  33. Wall E, Schillingmann L, Kummert F (2017) Online nod detection in human-robot interaction. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN), pp 811–817, https://doi.org/10.1109/ROMAN.2017.8172396

  34. Won AS, Bailenson JN, Stathatos SC et al (2014) Automatically detected nonverbal behavior predicts creativity in collaborating dyads. J Nonverbal Behav 38(3):389–408. https://doi.org/10.1007/s10919-014-0186-0

    Article  Google Scholar 

  35. Woolley AW, Chabris CF, Pentland A et al (2010) Evidence for a collective intelligence factor in the performance of human groups. Science 330(6004):686–688. https://doi.org/10.1126/science.1193147

    Article  Google Scholar 

  36. Wrede B, Shriberg E (2003) Spotting "hot spots" in meetings: human judgments and prosodic cues. In: Proc. 8th European Conference on Speech Communication and Technology (Eurospeech 2003), pp 2805–2808, https://doi.org/10.21437/Eurospeech.2003-747

  37. Yngve VH (1970) On getting a word in edgewise. Papers from the sixth regional meeting Chicago Linguistic Society, April 16-18, 1970, Chicago Linguistic Society, Chicago pp 567–578. https://cir.nii.ac.jp/crid/1571417124968122496

  38. Zhang Y, Olenick J, Chang CH et al (2018) Teamsense: Assessing personal affect and group cohesion in small teams through dyadic interaction and behavior analysis with wearable sensors. Proc ACM Interact Mob Wearable Ubiquitous Technol. https://doi.org/10.1145/3264960

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by a grant from the Ministry of Education, Culture, Sports, Science and Technology of Japan (MEXT) to support the Research Center for the Realization of Society 5.0 and JSPS Grant-in-Aid for Scientific Research 16H02891. The authors express their profound gratitude to the Nuclear Safety Systems Research Institute, Inc. for providing the experimental data in this study.

Author information

Author notes

  1. Kodai Ito, Ken Fujiwara, Kazuyuki Fujita and Yuichi Itoh have contributed equally to this work.

Authors and Affiliations

  1. Graduate School of Information Science and Technology, Osaka University, 2-1, Yamadaoka, Suita, Osaka, 5650871, Japan

    Kento Nishimura

  2. College of Science and Engineering, Aoyama Gakuin University, 5-10-1, Fuchinobe, Chuo-ku, Sagamihara, Miyagi, 2525258, Japan

    Kodai Ito & Yuichi Itoh

  3. Department of Psychology, National Chung Cheng University, No.168, Sec. 1, University Rd., Minhsiung, 621301, Chiayi, Taiwan

    Ken Fujiwara

  4. Research Institute of Electrical Communication, Tohoku University, 6-6 Aoba, Aramaki, Aoba-ku, Sendai, Kanagawa, 9808579, Japan

    Kazuyuki Fujita

Authors
  1. Kento Nishimura
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kodai Ito
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ken Fujiwara
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kazuyuki Fujita
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yuichi Itoh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kodai Ito.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nishimura, K., Ito, K., Fujiwara, K. et al. Detection of nodding of interlocutors using a chair-shaped device and investigating relationship between a divergent thinking task and amount of nodding. Qual User Exp 8, 10 (2023). https://doi.org/10.1007/s41233-023-00063-6

Download citation

  • Received:

  • Published:

  • DOI: https://doi.org/10.1007/s41233-023-00063-6

Keywords

Search

Navigation