Abstract
In recent years, several attempts have been made to preserve the cultural heritage sites, including the architectural ruins at Hampi, with the help of digital technology. A user’s experience of interaction with such heritage objects becomes more realistic if we incorporate haptics (a sense of touch) along with audio–visual rendering. Incorporation of haptic feedback allows people to touch and feel the objects irrespective of their locations. In this chapter, we discuss a combined hapto-visual-auditory rendering technique of 3D cultural heritage objects at multiple levels of spatial details. The frontal part of the object is represented as a Monge surface, and the object is shown in the the form of quad mesh. The challenging part of the research is to haptically render a Monge surface at different levels of details in real time during haptic interaction. A proxy-based haptic rendering technique is used to address these issues, with the proxy update frequency around one hundred times faster than the minimum haptic update frequency of 1000 Hz. We also incorporate some additional surface properties such as friction and texture to enhance the user experience. The surface texture information is captured by using a bilateral filter on the 3D depth data. The audio rendering is integrated by incorporation of appropriate position dependent audio clips. When a collision takes place, the corresponding audio note is played. The visualization of digitally preserved heritage structures may include animated characters which are often soft and inhomogeneous in material composition. In this case, the above-mentioned technique does not work as one has to accommodate deformation of the object during haptic interaction. In order to handle such objects, we discuss a physics-based rendering approach based on the Kirchhoff thin plate theory. Experimentations by several different subjects demonstrate that the such rendering techniques greatly enhance a user’s experience.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bergamasco M, Frisoli A, Barbagli F (2002) Haptics technologies and cultural heritage applications. In: Computer animation, pp 25–32
Praseedha A, Sreeni KG, Priyadarshini K, Chaudhuri S (2014) Combined hapto-visual and auditory rendering of cultural heritage objects. In: Computer vision-ACCV workshops. Singapore, pp 491–506
Sreeni KG, Priyadarshini K, Praseedha AK, Chaudhuri S (2012) Haptic rendering of cultural heritage objects at different scales. In: Proceedings of the Eurohaptics, Tampere, Finland, pp 505–516
Priyadarshini K, Sreeni KG, Chaudhuri S (2013) Scalable rendering of variable density point cloud data. In: World haptics conference (WHC), Daejeon, Korea, pp 91–96
Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Sixth international conference on computer vision, Mumbai, pp 839–846
Gluckman J (2006) Scale variant image pyramids. In: IEEE computer society conference on computer vision and pattern recognition, Rhode Island, pp 1069–1075
Burt PJ, Adelson EH (1983) The Laplacian pyramid as a compact image code. IEEE Trans Commun 532–540
Kumar A, Jayakumar T, Rao CB, Sharma GK, Rajkumar KV, Raj B, Arundhati P (2008) Nondestructive characterization of musical pillars of Mahamandapam of Vitthala Temple at Hampi, India. J Acoust Soc Am 911–917
Heiland M, Petersik A, Pflesser B, Tiede U, Schmelzle R, Höhne K-H Heinz H (2004) Realistic haptic interaction for computer simulation of dental surgery. In: International congress series; computer assisted radiology and surgery (CARS), Chicago, USA, pp 1226–1229
Okamura AM, Simone C, Mark L (2004) Force modeling for needle insertion into soft tissue. IEEE Trans Biomed Eng 1707–1716
Luciano CJ, Pat Banerjee P, Rizzi SHR (2007) GPU-based elastic-object deformation for enhancement of existing haptic applications. In: International conference on automation science and engineering (CASE), Arizona, USA, pp 146–151
Coquillart S (1990) Extended free-form deformation: a sculpturing tool for 3D geometric modeling. In: ACM SIGGRAPH computer graphics, vol 24, New York, USA, pp 187–196
Chan SC, Shing-Chow B, Nikolas H, Salisbury K (2013). Deformable haptic rendering for volumetric medical image data. In: World haptics conference (WHC), Daejeon, Korea, pp 73–78
Cirio G, Marchal M, Otaduy M, Lécuyer A (2013) Six-DoF haptic interaction with fluids, solids, and their transitions. In: World haptics conference (WHC), Daejeon, Korea, pp 157–162
Courtecuisse H, Allard J, Kerfriden P, Bordas S, Cotin S, Duriez C (2014) Real-time simulation of contact and cutting of heterogeneous soft-tissues. Med Image Anal 394–410
Gall J (1885) Use of cylindrical projections for geographical astronomical, and scientific purposes. Scott Geogr Mag 119–123
Ventsel E, Theodor K (2001) Thin plates and shells: theory analysis and applications. CRC Press
Sreeni K, Chaudhuri S (2012) Haptic rendering of dense 3D point cloud data. In: Haptics symposium (HAPTICS), Vancouver, Canada, pp 333–339
Priyadarshini K, Chaudhuri S (2016) Haptic rendering of thin, deformable objects with spatially varying stiffness. In:Eurohaptics 2016, London
Pratt V (1987) Direct least-squares fitting of algebraic surfaces. In: ACM SIGGRAPH computer graphics, pp 145–152
Salisbury K, Conti F, Barbagli F (2004) Haptic rendering: introductory concepts. In: IEEE computer graphics and applications magazine, special issue on haptic rendering, vol 24, pp 24–32
Chan SC, Blevins NH, Salisbury K (2013) Deformable haptic rendering for volumetric medical image data. In: World haptics conference (WHC), Daejeon, Korea, pp 73–78
Hammer P, Sacks M, Pedro J, Howe RD (2010) Mass-spring vs. finite element models of anisotropic heart valves: speed and accuracy. In: American society of mechanical engineers (ASME) summer bioengineering conference, Vancouver, Canada, pp 643–644
Acknowledgements
Authors gratefully acknowledge the funding support from National Programme on Perception Engineering Project from MeitY and The IDH Project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Chaudhuri, S., Priyadarshini, K. (2017). Cultural Heritage Objects: Bringing Them Alive Through Virtual Touch. In: Mallik, A., Chaudhury, S., Chandru, V., Srinivasan, S. (eds) Digital Hampi: Preserving Indian Cultural Heritage. Springer, Singapore. https://doi.org/10.1007/978-981-10-5738-0_20
Download citation
DOI: https://doi.org/10.1007/978-981-10-5738-0_20
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-5737-3
Online ISBN: 978-981-10-5738-0
eBook Packages: Computer ScienceComputer Science (R0)