Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3290605.3300814acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

SmartManikin: Virtual Humans with Agency for Design Tools

Published: 02 May 2019 Publication History

Abstract

When designing comfort and usability in products, designers need to evaluate aspects ranging from anthropometrics to use scenarios. Therefore, virtual and poseable mannequins are employed as a reference in early-stage tools and for evaluation in the later stages. However, tools to intuitively interact with virtual humans are lacking. In this paper, we introduceSmartManikin, a mannequin with agency that responds to high-level commands and to real-time design changes. We first captured human poses with respect to desk configurations, identified key features of the pose and trained regression functions to estimate the optimal features at a given desk setup. The SmartManikin's pose is generated by the predicted features as well as by using forward and inverse kinematics. We present our design, implementation, and an evaluation with expert designers. The results revealed that SmartManikin enhances the design experience by providing feedback concerning comfort and health in real time.

Supplementary Material

ZIP File (paper584vc.zip)
Video figure captions
MP4 File (paper584.mp4)
Supplemental video

References

[1]
Susanna Aromaa and Kaisa Väänänen. 2016. Suitability of virtual prototypes to support human factors/ergonomics evaluation during SmartManikin: Virtual Humans with Agency for Design Tools CHI 2019, May 4--9, 2019, Glasgow, Scotland UK the design. Applied Ergonomics 56, Supplement C (2016), 11 -- 18.
[2]
Mikhail Bessmeltsev, Nicholas Vining, and Alla Sheffer. 2016. Gesture3D: Posing 3D Characters via Gesture Drawings. ACM Trans. Graph. 35, 6, Article 165 (Nov. 2016), 13 pages.
[3]
P Blanchonette. 2018. Jack Human Modelling Tool: A Review. (09 2018).
[4]
U. Brandes and M. Erlhoff. 2012. My Desk is my Castle: Exploring Personalization Cultures. Birkhäuser. https://books.google.co.kr/books? id=3J_lYg0OR50C
[5]
Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, 424--433.
[6]
Colin Burns, Eric Dishman, William Verplank, and Bud Lassiter. 1994. Actors, hairdos & videotape - informance design. In Conference Companion on Human Factors in Computing Systems (CHI '94). ACM, New York, NY, USA, 119--120.
[7]
J.M. Carroll. 1995. Scenario-based design: envisioning work and technology in system development. Wiley. https://books.google.co.kr/books? id=idhQAAAAMAAJ
[8]
J. B. CARTER and E. W. BANISTER. 1994. Musculoskeletal problems in VDT work: a review. Ergonomics 37, 10 (1994), 1623--1648. 7957019.
[9]
Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A Efros. 2018. Everybody dance now. arXiv preprint arXiv:1808.07371 (2018).
[10]
Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4680--4691.
[11]
Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2018. Designing for Multiple Hand Grips and Body Postures Within the UX of a Moving Smartphone. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 611--621.
[12]
Petros Faloutsos, Michiel van de Panne, and Demetri Terzopoulos. 2001. The virtual stuntman: Dynamic characters with a repertoire of autonomous motor skills. 25 (12 2001), 933--953.
[13]
Tian Feng, Lap-Fai Yu, Sai-Kit Yeung, KangKang Yin, and Kun Zhou. 2016. Crowd-driven mid-scale layout design. ACM Trans. Graph. 35, 4 (2016), 132--1.
[14]
Madeline Gannon, Tovi Grossman, and George Fitzmaurice. 2015. Tactum: A Skin-Centric Approach to Digital Design and Fabrication. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1779--1788.
[15]
Madeline Gannon, Tovi Grossman, and George Fitzmaurice. 2016. ExoSkin: On-Body Fabrication. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5996--6007.
[16]
Alejandra García Rojas, Frédéric Vexo, and Daniel Thalmann. 2006. Individualized Reaction Movements for Virtual Humans. In Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia (GRAPHITE '06). ACM, New York, NY, USA, 79--85.
[17]
Marco Gillies and Neil A. Dodgson. 2004. Behaviourally rich actions for user-controlled characters. Computers & Graphics 28, 6 (2004), 945 -- 954.
[18]
M. F. P. Gillies and N. A. Dodgson. 2002. Eye movements and attention for behavioural animation. The Journal of Visualization and Computer Animation 13, 5 (2002), 287--300.
[19]
Oliver Glauser, Wan-Chun Ma, Daniele Panozzo, Alec Jacobson, Otmar Hilliges, and Olga Sorkine-Hornung. 2016. Rig Animation with a Tangible and Modular Input Device. ACM Trans. Graph. 35, 4, Article 144 (July 2016), 11 pages.
[20]
Karl Grainger, Zoe Dodson, and Thomas Korff. 2017. Predicting bicycle setup for children based on anthropometrics and comfort. Applied Ergonomics 59 (2017), 449 -- 459.
[21]
Fabian Hahn, Frederik Mutzel, Stelian Coros, Bernhard Thomaszewski, Maurizio Nitti, Markus Gross, and Robert W. Sumner. 2015. Sketch Abstractions for Character Posing. In Proceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA '15). ACM, New York, NY, USA, 185--191.
[22]
M. Susan Hallbeck, Tim Bosch, Gu (J. W.) Van Rhijn, Frank Krause, Michiel P. de Looze, and Peter Vink. 2010. A tool for early workstation design for small and medium enterprises evaluated in five cases. Human Factors and Ergonomics in Manufacturing & Service Industries 20, 4 (2010), 300--315.
[23]
Daniel Holden, Taku Komura, and Jun Saito. 2017. Phase-functioned neural networks for character control. ACM Transactions on Graphics (TOG) 36, 4 (2017), 42.
[24]
Shih-Wen Hsiao, Rong-Qi Chen, and Wan-Lee Leng. 2015. Applying riding-posture optimization on bicycle frame design. 51 (11 2015).
[25]
Alec Jacobson, Daniele Panozzo, Oliver Glauser, Cédric Pradalier, Otmar Hilliges, and Olga Sorkine-Hornung. 2014. Tangible and Modular Input Device for Character Articulation. ACM Trans. Graph. 33, 4, Article 82 (July 2014), 12 pages.
[26]
Michael Patrick Johnson, Andrew Wilson, Bruce Blumberg, Christopher Kline, and Aaron Bobick. 1999. Sympathetic Interfaces: Using a Plush Toy to Direct Synthetic Characters. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 152--158.
[27]
Changgu Kang and Sung-Hee Lee. 2017. Multi-contact locomotion using a contact graph with feasibility predictors. ACM Transactions on Graphics (TOG) 36, 2 (2017), 22.
[28]
IJ Kant, LCGM de Jong, M van Rijssen-Moll, and PJA Borm. 1992. A survey of static and dynamic work postures of operating room staff. International archives of occupational and environmental health 63, 6 (1992), 423--428.
[29]
Rubaiat Habib Kazi, Tovi Grossman, Hyunmin Cheong, Ali Hashemi, and George Fitzmaurice. 2017. DreamSketch: Early Stage 3D Design Explorations with Sketching and Generative Design. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 401--414.
[30]
Sonu Chopra Khullar and Norman I. Badler. 2001. Where to Look? Automating Attending Behaviors of Virtual Human Characters. Autonomous Agents and Multi-Agent Systems 4, 1 (01 Mar 2001), 9--23.
[31]
Han-Jong Kim, Chang Min Kim, and Tek-Jin Nam. 2018. SketchStudio: Experience Prototyping with 2.5-Dimensional Animated Design Scenarios. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 831--843.
[32]
Vladimir G Kim, Siddhartha Chaudhuri, Leonidas Guibas, and Thomas Funkhouser. 2014. Shape2pose: Human-centric shape analysis. ACM Transactions on Graphics (TOG) 33, 4 (2014), 120. CHI 2019, May 4--9, 2019, Glasgow, Scotland UK B. Lee et al.
[33]
Yongkwan Kim and Seok-Hyung Bae. 2016. SketchingWithHands: 3D Sketching Handheld Products with First-Person Hand Posture. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 797--808.
[34]
Yeonjoon Kim, Hangil Park, Seungbae Bang, and Sung-Hee Lee. 2016. Retargeting human-object interaction to virtual avatars. IEEE transactions on visualization and computer graphics 22, 11 (2016), 2405--2412.
[35]
Scott R. Klemmer, Björn Hartmann, and Leila Takayama. 2006. How Bodies Matter: Five Themes for Interaction Design. In Proceedings of the 6th Conference on Designing Interactive Systems (DIS '06). ACM, New York, NY, USA, 140--149.
[36]
SchÃjldt Kristina, Ekholm Jan, Harms-Ringdahl Karin, NÃlmeth Gunnar, and P Arborelius Ulf. 1986. Effects of changes in sitting work posture on static neck and shoulder muscle activity. Ergonomics 29, 12 (1986), 1525--1537. 3816746.
[37]
James Kuffner and Jean-claude Latombe. 1999. Fast synthetic vision, memory, and learning models for virtual humans. In Proceedings Computer Animation 1999. 118--127.
[38]
Bokyung Lee, Minjoo Cho, Joonhee Min, and Daniel Saakes. 2016. Posing and Acting As Input for Personalizing Furniture. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA, Article 44, 10 pages.
[39]
Bokyung Lee, Joongi Shin, Hyoshin Bae, and Daniel Saakes. 2018. Interactive and Situated Guidelines to Help Users Design a Personal Desk That Fits Their Bodies. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 637--650.
[40]
N. Magnenat-Thalmann and N. Ichalkaranje. 2008. New Advances in Virtual Humans: Artificial Intelligence Environment. Springer Berlin Heidelberg. https://books.google.co.kr/books?id=nffaBtjFQvAC
[41]
M Marschall, AC Harrington, and JR Steele. 1995. Effect of work station design on sitting posture in young children. Ergonomics 38, 9 (1995), 1932--1940. 7671868.
[42]
Bonnie L. Webber Norman I. Badler, Welton M. Becket. 1995. Simulation and analysis of complex human tasks for manufacturing. (1995).
[43]
Naoki Numaguchi, Atsushi Nakazawa, Takaaki Shiratori, and Jessica K. Hodgins. 2011. A Puppet Interface for Retrieval of Motion Capture Data. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '11). ACM, New York, NY, USA, 157--166.
[44]
Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen. 2003. Understanding contexts by being there: case studies in bodystorming. Personal and Ubiquitous Computing 7, 2 (01 Jul 2003), 125--134.
[45]
S. Pheasant and C.M. Haslegrave. 2016. Bodyspace: Anthropometry, Ergonomics and the Design of Work, Third Edition. CRC Press. https: //books.google.co.kr/books?id=9ny_CwAAQBAJ
[46]
Olivier Renault, Nadia Magnenat Thalmann, and Daniel Thalmann. 1990. A vision-based approach to behavioural animation. The Journal of Visualization and Computer Animation 1, 1 (1990), 18--21.
[47]
Marianne Dooley Rockwell. 1982. Anthropometric Modeling ProgramsA Survey. IEEE Computer Graphics and Applications 2 (1982), 17--25.
[48]
Daniel Saakes, Thomas Cambazard, Jun Mitani, and Takeo Igarashi. 2013. PacCAM: Material Capture and Interactive 2D Packing for Efficient Material Usage on CNC Cutting Machines. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 441--446.
[49]
Daniel Saakes, Hui-Shyong Yeo, Seung-Tak Noh, Gyeol Han, and Woontack Woo. 2016. Mirror Mirror: An On-Body T-shirt Design System. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 6058--6063.
[50]
Greg Saul, Manfred Lau, Jun Mitani, and Takeo Igarashi. 2011. SketchChair: An All-in-one Chair Design System for End Users (TEI). 73--80.
[51]
Davide Schaumann, Simon Breslav, Rhys Goldstein, Azam Khan, and Yehuda E Kalay. 2017. Simulating use scenarios in hospitals using multi-agent narratives. Journal of Building Performance Simulation 10, 5--6 (2017), 636--652.
[52]
Dennis Schleicher, Peter Jones, and Oksana Kachur. 2010. Bodystorming As Embodied Designing. Interactions 17, 6 (Nov. 2010), 47--51.
[53]
Donald A Schön. 1983. The reflective practitionerhow professionals think in action. (1983).
[54]
Wei Shao and Demetri Terzopoulos. 2005. Autonomous Pedestrians. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '05). ACM, New York, NY, USA, 19--28.
[55]
Siemens. 1996. Jack. https://www.plm.automation.siemens.com/store/enca/jack/index.html. (1996).
[56]
Bill Tomlinson, Marc Downie, Matt Berlin, Jesse Gray, Derek Lyons, Jennie Cochran, and Bruce Blumberg. 2002. Leashing the AlphaWolves: Mixing User Direction with Autonomous Emotion in a Pack of Semiautonomous Virtual Characters. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '02). ACM, New York, NY, USA, 7--14.
[57]
Steve Tonneau, Rami Ali Al-Ashqar, Julien Pettré, Taku Komura, and Nicolas Mansard. 2016. Character contact re-positioning under large environment deformation. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 127--138.
[58]
Steve Tonneau, Andrea Prete, Julien Pettré, and Nicolas Mansard. 2017. 2PAC: Two Point Attractors for Center of Mass Trajectories in Multi Contact Scenarios. (2017).
[59]
Spyros Vosinakis and Themis Panayiotopoulos. 2001. SimHuman: A Platform for Real-Time Virtual Agents with Planning Capabilities. In Intelligent Virtual Agents, Angélica de Antonio, Ruth Aylett, and Daniel Ballin (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 210--223.
[60]
Amy Wibowo, Daisuke Sakamoto, Jun Mitani, and Takeo Igarashi. 2012. DressUp: A 3D Interface for Clothing Design with a Physical Mannequin. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). ACM, New York, NY, USA, 99--102.
[61]
Wataru Yoshizaki, Yuta Sugiura, Albert C. Chiou, Sunao Hashimoto, Masahiko Inami, Takeo Igarashi, Yoshiaki Akazawa, Katsuaki Kawachi, Satoshi Kagami, and Masaaki Mochimaru. 2011. An Actuated Physical Puppet As an Input Device for Controlling a Digital Manikin. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 637--646.
[62]
Lap-Fai Yu, Sai-Kit Yeung, Chi-Keung Tang, Demetri Terzopoulos, Tony F. Chan, and Stanley J. Osher. 2011. Make It Home: Automatic Optimization of Furniture Arrangement. In ACM SIGGRAPH 2011 Papers (SIGGRAPH '11). ACM, New York, NY, USA, Article 86, 12 pages. SmartManikin: Virtual Humans with Agency for Design Tools CHI 2019, May 4--9, 2019, Glasgow, Scotland UK
[63]
J. Zeisel and J.P. Eberhard. 2006. Inquiry by Design: Environment/behavior/neuroscience in Architecture, Interiors, Landscape, and Planning. W.W. Norton. https://books.google.co.kr/books?id= voeTQgAACAAJ
[64]
Yupeng Zhang, Teng Han, Zhimin Ren, Nobuyuki Umetani, Xin Tong, Yang Liu, Takaaki Shiratori, and Xiang Cao. 2013. BodyAvatar: Creating Freeform 3D Avatars Using First-person Body Gestures. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 387--396.
[65]
Xi Zhao, Myung Geol Choi, and Taku Komura. 2017. Character-Object Interaction Retrieval using the Interaction Bisector Surface. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 119--129.

Cited By

View all
  • (2024)A Virtual Reality Direct-Manipulation Tool for Posing and Animation of Digital Human Bodies: An Evaluation of Creativity SupportMultimodal Technologies and Interaction10.3390/mti80700608:7(60)Online publication date: 10-Jul-2024
  • (2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
  • (2024)When and How to Use AI in the Design Process? Implications for Human-AI Design CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2353451(1-16)Online publication date: 22-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
May 2019
9077 pages
ISBN:9781450359702
DOI:10.1145/3290605
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. design tool
  2. human agent
  3. simulation
  4. virtual human

Qualifiers

  • Research-article

Funding Sources

  • Basic Science Research Program through the National Research Foundation of Korea
  • Global Frontier R\&D Program funded by NRF, MSIP, Korea

Conference

CHI '19
Sponsor:

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)65
  • Downloads (Last 6 weeks)7
Reflects downloads up to 03 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A Virtual Reality Direct-Manipulation Tool for Posing and Animation of Digital Human Bodies: An Evaluation of Creativity SupportMultimodal Technologies and Interaction10.3390/mti80700608:7(60)Online publication date: 10-Jul-2024
  • (2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
  • (2024)When and How to Use AI in the Design Process? Implications for Human-AI Design CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2353451(1-16)Online publication date: 22-May-2024
  • (2024)Developing a Digital Human Modeling Toolset: Simulating Elderly Posture in Grasshopper to Optimize Living EnvironmentsJournal of Building Engineering10.1016/j.jobe.2024.109308(109308)Online publication date: Apr-2024
  • (2023)I Perform My Work with My Body Too: Integrating Body Representations in and with Task ModelsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42283-6_26(482-503)Online publication date: 25-Aug-2023
  • (2022)Improving Workflow Integration with xPath: Design and Evaluation of a Human-AI Diagnosis System in PathologyACM Transactions on Computer-Human Interaction10.1145/357701130:2(1-37)Online publication date: 16-Dec-2022
  • (2022)Understanding the Roles of Intelligent Product-Customization Systems Through Expert Interviews[ ] With Design: Reinventing Design Modes10.1007/978-981-19-4472-7_76(1153-1169)Online publication date: 6-Nov-2022
  • (2021)Designing a Multi-Agent Occupant Simulation System to Support Facility Planning and Analysis for COVID-19Proceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462030(15-30)Online publication date: 28-Jun-2021
  • (2021)Socio-Spatial ComfortProceedings of the ACM on Human-Computer Interaction10.1145/34329374:CSCW3(1-33)Online publication date: 5-Jan-2021
  • (2020)Challenges in interaction modelling with digital human models – A systematic literature review of interaction modelling approachesErgonomics10.1080/00140139.2020.178660663:11(1442-1458)Online publication date: 8-Jul-2020
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media