Molecular Augmented Reality for Design and Engineering (MADE): Effectiveness of AR Models on Discovery, Learning, and Education

The design and manipulation of chemical systems involves understanding the form or morphology of chemical structures. An understand of the form of chemical structure includes an understanding of the components of chemical structure, the functions of the forms and sub-components, and changes in the structure of chemical systems during interaction, maturation, or chemical processes. Viewed from a computer graphic viewpoint these chemical processes can be described and modelled as three-dimensional structures, changing shape, and interacting with other 3D structures. Furthermore, our intuition was that the visualization should be as embodied as possible and open for collaboration.

In this project we seek to create a tool for collaborative, embodied visualization of biomolecules. To achieve this interaction with targeted for hand on visualizations allowing for biomolecular exploration and scientific visualization within immersive augmented reality platforms. We anticipate a tool where components can assist both in (1) biomolecule discovery and design and a subset applicable for (2) education in biomolecules. We conducted some formative research to analyze user value and requirement.

For the prototype we focused on the visualization of DNA binding protein, called Zip Proteins. These proteins are transcription factors. This system is implemented across two devices that support AR capabilities: head mount display (HMD) and the mobile phone. Key development is the porting of these molecules to immersive augmented reality environment for direct interaction.

Describing the advantage of the platform for this application at the broadest level, we can say that augmented reality platforms allow for full embodied interaction with the structures at any scale and contextualized by the physical background. We also discuss future plans for this platform.

Authors and Affiliations

1. New Jersey Institute of Technology, Newark, NJ, 07102, USA

   Hyejin Hannah Kum-Biocca, Edgardo T. Farinas, Nisha Mistry & Yutong Wan

Corresponding author

Correspondence to Hyejin Hannah Kum-Biocca .

Editors and Affiliations

1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

   Constantine Stephanidis

2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

   Margherita Antona

3. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

   Stavroula Ntoa

Reprints and permissions

© 2020 Springer Nature Switzerland AG

Policies and ethics