research-article

Public Access

Automated reconstruction of smoothly joining 3D printed restorations to fix broken objects

Authors:

Natasha Kholgade BanerjeeAuthors Info & Claims

SCF '19: Proceedings of the 3rd Annual ACM Symposium on Computational Fabrication

Article No.: 3, Pages 1 - 12

https://doi.org/10.1145/3328939.3329005

Published: 16 June 2019 Publication History

Abstract

In this work, we provide an approach to automatically reconstruct a 3D printed restoration piece for a broken object from 3D scanned meshes of the broken object and an original counterpart. Our approach provides two contributions to reconstruct a restoration with a smooth join to the broken object, necessary for object functionality such as liquid containment, injury prevention, and visual aesthetic. As our first contribution, we leverage the original counterpart mesh to grow an exterior surface for the restoration piece that approaches the broken object within a small tolerance. As our second contribution, we project the exterior surface boundary onto the broken object to create a fracture surface boundary whose vertices satisfy the constraints of proximity, normal alignment, and tangency to vertices on the exterior surface boundary. Our approach prevents artifacts of volumetric Boolean subtraction, such as floating components and thin long slivers at the join, and avoids ruts at the join region introduced by Euclidean distance thresholding. We show 3D printed restoration results for 14 objects and 3D printable results for 8 objects.

References

[1]

Kaja Antlej, Miran Eric, Mojca Šavnik, Bernarda Županek, Janja Slabe, and Borut Battestin. 2011. Combining 3D technologies in the field of cultural heritage: three case studies. In Proceedings of the Conference VAST: The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage-Short and Project Papers (Prato 2011). The Eurographics Association, 1--4.

[2]

Lucia Arbace, Elisabetta Sonnino, Marco Callieri, Matteo Dellepiane, Matteo Fabbri, Antonio Iaccarino Idelson, and Roberto Scopigno. 2013. Innovative uses of 3D digital technologies to assist the restoration of a fragmented terracotta statue. Journal of Cultural Heritage 14, 4 (2013), 332--345.

[3]

Paul J. Besl and Neil D. McKay. 1992. A Method for Registration of 3-D Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2 (Feb. 1992), 239--256.

Digital Library

[4]

Marcel Campen and Leif Kobbelt. 2010. Exact and robust (self-) intersections for polygonal meshes. In Computer Graphics Forum, Vol. 29. Wiley Online Library, The Eurographics Association and Blackwell Publishing Ltd, Malden, MA, 397--406.

[5]

Paolo Cignoni, Marco Callieri, Massimiliano Corsini, Matteo Dellepiane, Fabio Ganovelli, and Guido Ranzuglia. 2008. Meshlab: an open-source mesh processing tool. In Eurographics Italian chapter conference, Vol. 2008. The Eurographics Association, Salerno, Italy, 129--136.

[6]

Edsger W Dijkstra. 1959. Anote on two problems in connexion with graphs. Numerische mathematik 1, 1 (1959), 269--271.

Digital Library

[7]

Massimiliano Fantini, Francesca de Crescenzio, Franco Persiani, Stefano Benazzi, and Giorgio Gruppioni. 2008. 3D restitution, restoration and prototyping of a medieval damaged skull. Rapid Prototyping Journal 14, 5 (2008), 318--324.

[8]

Roberto L Flores, Hannah Liss, Samuel Raffaelli, Aiza Humayun, Kimberly S Khouri, Paulo G Coelho, and Lukasz Witek. 2017. The technique for 3D printing patient-specific models for auricular reconstruction. Journal of Cranio-Maxillofacial Surgery 45, 6 (2017), 937--943.

[9]

Jian Gao, Xin Chen, Oguzhan Yilmaz, and Nabil Gindy. 2008. An integrated adaptive repair solution for complex aerospace components through geometry reconstruction. The International Journal of Advanced Manufacturing Technology 36, 11--12 (2008), 1170--1179.

[10]

Jian Gao, Janet Folkes, Oguzhan Yilmaz, and Nabil Gindy. 2005. Investigation of a 3D non-contact measurement based blade repair integration system. Aircraft Engineering and Aerospace Technology 77, 1 (2005), 34--41.

[11]

Robert Gregor, Ivan Sipiran, Georgios Papaioannou, Tobias Schreck, Anthousis Andreadis, and Pavlos Mavridis. 2014. Towards Automated 3D Reconstruction of Defective Cultural Heritage Objects. In Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage (GCH '14). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 135--144.

Digital Library

[12]

Ola LA Harrysson, Yasser A Hosni, and Jamal F Nayfeh. 2007. Custom-designed orthopedic implants evaluated using finite element analysis of patient-specific computed tomography data: femoral-component case study. BMC musculoskeletal disorders 8, 1 (2007), 91.

[13]

Renato Hermoza and Ivan Sipiran. 2018. 3D Reconstruction of Incomplete Archaeological Objects Using a Generative Adversarial Network. In Proceedings of Computer Graphics International 2018 (CGI 2018). ACM, New York, NY, USA, 5--11.

Digital Library

[14]

Ping Hu, Changsheng Wang, Baojun Li, and Mingzeng Liu. 2012. Filling Holes in Triangular Meshes in Engineering. JSW 7, 1 (2012), 141--148.

[15]

International Council of Museums. 2017. ICOM Code of Ethics for Museums. International Council of Museums, Paris, France. 30 pages.

[16]

Alec Jacobson et al. 2018. gptoolbox: Geometry Processing Toolbox. http://github.com/alecjacobson/gptoolbox.

[17]

Jane Lee. 2013. 5 Ways Smithsonian Uses 3-D Scanning to Open Up History. http://news.nationalgeographic.com/news/2013/09/130904-3d-printing-smithsonian-whale-skeleton-technology-science/. National Geographic 9 (2013), 1.

[18]

Nicolas Mellado, Dror Aiger, and Niloy J Mitra. 2014. Super 4pcs fast global pointcloud registration via smart indexing. In Computer Graphics Forum, Vol. 33. Wiley Online Library, The Eurographics Association and Blackwell Publishing Ltd, Malden, MA, 205--215.

[19]

Georgios Papaioannou, Tobias Schreck, Anthousis Andreadis, Pavlos Mavridis, Robert Gregor, Ivan Sipiran, and Konstantinos Vardis. 2017. From reassembly to object completion: A complete systems pipeline. Journal on Computing and Cultural Heritage (JOCCH) 10, 2 (2017), 8.

Digital Library

[20]

Mark Pauly, Niloy J. Mitra, Joachim Giesen, Markus Gross, and Leonidas J. Guibas. 2005. Example-based 3D Scan Completion. In Proceedings of the Third Eurographics Symposium on Geometry Processing (SGP '05). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 23--32.

Digital Library

[21]

Fabian Rengier, Amit Mehndiratta, Hendrik Von Tengg-Kobligk, Christian M Zechmann, Roland Unterhinninghofen, H-U Kauczor, and Frederik L Giesel. 2010. 3D printing based on imaging data: review of medical applications. International journal of computer assisted radiology and surgery 5, 4 (2010), 335--341.

[22]

Jason Rock, Tanmay Gupta, Justin Thorsen, JunYoung Gwak, Daeyun Shin, and Derek Hoiem. 2015. Completing 3d object shape from one depth image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Piscataway, NJ, 2484--2493.

[23]

Roberto Scopigno, Marco Callieri, Paolo Cignoni, Massimiliano Corsini, Matteo Dellepiane, Federico Ponchio, and Guido Ranzuglia. 2011. 3D models for cultural heritage: beyond plain visualization. Computer 44, 7 (2011), 48--55.

Digital Library

[24]

Maria Luiza Seixas, Paulo Santos Assis, João Cura DâĂ&Zacute;Ars Figueiredo Jr, Maria Aparecida Pinto, and Daniella Gualberto Caldeira Paula. 2018. The use of rapid prototyping in the joining of fractured historical silver object. Rapid Prototyping Journal 24, 3 (2018), 532--538.

[25]

Sekou Singare, Yaxiong Liu, Dichen Li, Bingheng Lu, and Sanhu He. 2008. Individually prefabricated prosthesis for maxilla reconstruction. Journal of Prosthodontics 17, 2 (2008), 135--140.

[26]

Ivan Sipiran, Robert Gregor, and Tobias Schreck. 2014. Approximate Symmetry Detection in Partial 3D Meshes. Comput. Graph. Forum 33, 7 (Oct. 2014), 131--140.

Digital Library

[27]

Olga Sorkine, Daniel Cohen-Or, Yaron Lipman, Marc Alexa, Christian Rössl, and H-P Seidel. 2004. Laplacian surface editing. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing. ACM, New York, NY, 175--184.

Digital Library

[28]

David Stutz and Andreas Geiger. 2018. Learning 3d shape completion from laser scan data with weak supervision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Piscataway, NJ, 1955--1964.

[29]

Nigel Williams. 2002. Porcelain: repair and restoration, a handbook. University of Pennsylvania Press, Philadelphia, PA.

[30]

Lukasz Witek, Kimberly S Khouri, Paulo G Coelho, and Roberto L Flores. 2016. Patient-specific 3D models for autogenous ear reconstruction. Plastic and Reconstructive Surgery-Global Open 4, 10 (2016), e1093.

[31]

Jianming Zheng, Zhongguo Li, and Xi Chen. 2006. Worn area modeling for automating the repair of turbine blades. The International Journal of Advanced Manufacturing Technology 29, 9--10 (2006), 1062--1067.

Cited By

Altansukh AYou MAltantsetseg EKhorloo OChiba FKonno K(2024)A New Matching Algorithm for Stone Tool Reassembly Based on Contour Points of Flake SurfaceThe Journal of the Society for Art and Science10.3756/artsci.23.4_123:2(4_1-4_17)Online publication date: 26-Jun-2024
https://doi.org/10.3756/artsci.23.4_1
Mei YJones BCascaval DMankoff JVouga ESchulz A(2024)FabHacks: Transform Everyday Objects into Home Hacks Leveraging a Solver-aided DSLProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665788(1-16)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665788
Abdullah MSeidel LWernicke BGouasmi MHackl AKern TLempert CLempert CBizer DStorch WFang CBaudisch P(2024)PopCore: Personal Fabrication of 3D Foamcore Models for Professional High-Quality Applications in Design and ArchitectureProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665787(1-14)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665787
Show More Cited By

Index Terms

Automated reconstruction of smoothly joining 3D printed restorations to fix broken objects
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
      1. Mesh models
      2. Shape analysis

Recommendations

DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair

We introduce DeepJoin, an automated approach to generate high-resolution repairs for fractured shapes using deep neural networks. Existing approaches to perform automated shape repair operate exclusively on symmetric objects, require a complete proxy ...
Using Learned Visual and Geometric Features to Retrieve Complete 3D Proxies for Broken Objects
SCF '21: Proceedings of the 6th Annual ACM Symposium on Computational Fabrication

3D printing offers the opportunity to perform automated restoration of objects to reduce household waste, restore objects of cultural heritage, and automate repair in medical and manufacturing domains. We present an approach that takes a 3D model of a ...
Physically-Based Simulation of Objects Represented by Surface Meshes
CGI '04: Proceedings of the Computer Graphics International

Objects and scenes in virtual worlds such as 3-d computergames are typically represented by polygonal surfacemeshes. On the other hand, physically-based simulationsof deformations or fracture effects require volumetricrepresentations such as tetrahedral ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SCF '19: Proceedings of the 3rd Annual ACM Symposium on Computational Fabrication

June 2019

106 pages

ISBN:9781450367950

DOI:10.1145/3328939

Editor:
Stephen N. Spencer
University of Washington
,
General Chairs:
James McCann
Carnegie Mellon University
,
Lining Yao
Carnegie Mellon University

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

SCF '19

Sponsor:

SIGGRAPH

SCF '19: Symposium on Computational Fabrication

June 16 - 18, 2019

Pennsylvania, Pittsburgh

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
500
Total Downloads

Downloads (Last 12 months)131
Downloads (Last 6 weeks)38

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Altansukh AYou MAltantsetseg EKhorloo OChiba FKonno K(2024)A New Matching Algorithm for Stone Tool Reassembly Based on Contour Points of Flake SurfaceThe Journal of the Society for Art and Science10.3756/artsci.23.4_123:2(4_1-4_17)Online publication date: 26-Jun-2024
https://doi.org/10.3756/artsci.23.4_1
Mei YJones BCascaval DMankoff JVouga ESchulz A(2024)FabHacks: Transform Everyday Objects into Home Hacks Leveraging a Solver-aided DSLProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665788(1-16)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665788
Abdullah MSeidel LWernicke BGouasmi MHackl AKern TLempert CLempert CBizer DStorch WFang CBaudisch P(2024)PopCore: Personal Fabrication of 3D Foamcore Models for Professional High-Quality Applications in Design and ArchitectureProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665787(1-14)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665787
Abbasnezhad N(2024)A Joining Strategy for the Stereolithography-Printed Parts: Thermal and Mechanical CharacterizationJournal of Materials Engineering and Performance10.1007/s11665-024-09816-6Online publication date: 22-Jul-2024
https://doi.org/10.1007/s11665-024-09816-6
Song XLamb NBanerjee SBanerjee N(2023)Reinforcement-Learning Based Robotic Assembly of Fractured Objects Using Visual and Tactile Information2023 9th International Conference on Automation, Robotics and Applications (ICARA)10.1109/ICARA56516.2023.10125938(170-174)Online publication date: 10-Feb-2023
https://doi.org/10.1109/ICARA56516.2023.10125938
Lamb NPalmer CMolloy BBanerjee SBanerjee N(2023)Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterparts2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00454(4681-4691)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00454
Liu STu YWang XQin BXie ZZhang YZhang HHu D(2022)Transparent reversible prosthesis, a new way to complete the conservation–restoration of a Black Ding bowl with application of 3D technologiesHeritage Science10.1186/s40494-022-00646-010:1Online publication date: 24-Jan-2022
https://doi.org/10.1186/s40494-022-00646-0
Lamb NBanerjee SBanerjee N(2022)DeepJoinACM Transactions on Graphics10.1145/3550454.355547041:6(1-10)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555470
Lamb NBanerjee SBanerjee N(2022)DeepMend: Learning Occupancy Functions to Represent Shape for RepairComputer Vision – ECCV 202210.1007/978-3-031-20062-5_25(433-450)Online publication date: 11-Nov-2022
https://doi.org/10.1007/978-3-031-20062-5_25
Lamb NWiederhold NLamb BBanerjee SBanerjee N(2021)Using Learned Visual and Geometric Features to Retrieve Complete 3D Proxies for Broken ObjectsProceedings of the 6th Annual ACM Symposium on Computational Fabrication10.1145/3485114.3485118(1-15)Online publication date: 28-Oct-2021
https://dl.acm.org/doi/10.1145/3485114.3485118

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents