Just Accepted
A Deep Learning-based Method of Investigating Rammed-earth Wall Damage on the Ming Great Wall Military Defense System
Accepted on 04 October 2024
Abstract
The collection, detection, and statistical analysis of massive damage information from large cultural heritage sites is an important issue that affects the progress, depth, and quality of cultural heritage protection efforts. The Ming Great Wall of China, known for its vast size, poses a significant challenge to protection efforts. Conventional methods for collecting and recognizing damage information from the wall are nearly impossible due to its scale. The limitation has significantly hindered efforts to safeguard the vulnerable rammed-earth walls of the Ming Great Wall. To address this issue, we developed new technical schemes that combine the efficiency of unmanned aerial vehicles (UAV) for low-altitude surveying and mapping with the accuracy of artificial intelligence detection. This enables the efficient collection, detection, and statistical analysis of a massive amount of damage data from the Great Wall sites. The system achieved an average damage detection accuracy of 0.838, as measured by the average precision (AP). Additionally, the system's average effective detection range exceeded 91.5%, while reducing manual labor time by about 95%. These results provide accurate, efficient, and timely data and technical support for efforts such as status investigation, condition evaluation, protection and maintenance, and budgeting for the Great Wall sites. Furthermore, this research proposes a potential approach for gathering and analyzing data from other large-scale cultural heritage sites.
References
[1]
Peter Spring, Great Walls & Linear Barriers, Pen & Sword Military, (2015).
[2]
Chen Jun, Jin Shuping, et al., Stereo mapping of Ming Great Wall with remote sensing, Chinese Science Bulletin, 55(21) (2010), pp. 2290-2294, 10.1007/s11434-010-4295-9.
[3]
Cao Yingchun, Zhang Yukun, The fractal structure of the Ming Great Wall Military Defense System: A revised horizon over the relationship between the Great Wall and the military defense settlements, Journal of Cultural Heritage, 33 (2018), pp. 159-169, 10.1016/j.culher.2018.03.010.
[4]
Li Xiaojuan, Gong Huili, et al., Research on the damage of the Great Wall of Ming Dynasty in Beijing by remote sensing, Science in China Series E-Technological Sciences, 51 (2008), pp. 195-202, 10.1007/s11431-008-5001-x.
[5]
Pu Tianbiao, Chen Wenwu, et al., Snowfall-related deterioration behavior of the Ming Great Wall in the eastern Qinghai-Tibet Plateau, Natural Hazards, 84 (3) (2016), pp. 1539-1550, 10.1007/s11069-016-2497-4.
[6]
Sun Manli, Li Zuixiong, Wang Xudong, Chen Wenwu, Classification of Deteriorations Associated with many Earthen Heritage Sites in Arid Areas of Northwest China, Journal of Engineering Geology, 06 (2007), pp. 772-778+765, 10.3969/j.issn.1004-9665.2007.06.009.
[7]
Chen Fulong, Zhou Wei, et al., Space Technology Facilitates the Preventive Monitoring and Preservation of the Great Wall of the Ming Dynasty: A Comparative Study of the Qingtongxia, IEEE Journal of Selected Topics in Applied Earth Observations And Remote Sensing, 13 (2020), pp. 5719-5729, 10.1109/JSTARS.2020.3023297
[8]
Tang Hongmin, Shi Yucheng, Liu Kun, Lu Yuxia, Guo Peng, Wei Lai, Li Tonglin, Study on the Disease Behavior of the Great Wall of the Ming Dynasty along the Silk Road, China Earthquake Engineering Journal, 06 (2018), pp. 1278-1286: 10.3969/j.issn.1000-0844.2018.06.1278.
[9]
Du Yumin, Chen Wenwu, et al., A Model Characterizing Deterioration at Earthen Sites of the Ming Great Wall in Qinghai Province, China, Soil Mechanics and Foundation Engineering, 53 (2017), pp. 426-434, 10.1007/s11204-017-9423-y.
[10]
The Great Wall resources survey of National Cultural Heritage Administration of China. (http://www.cach.org.cn/tabid/161/Default.aspx)
[11]
Review and prospect of the Great Wall resources investigation in Inner Mongolia Autonomous Region(http://blog.sina.com.cn/s/blog_5e317b050102wxkt.html)
[12]
Hebei Provincial Bureau of cultural relics, etc., Survey Report on Resources of the Ming Great Wall in Hebei Province (Volume Laiyuan), Cultural Relics Press (2010).
[13]
Shaanxi Provincial Institute of Archaeology, Survey Report on Resources of the Ming Great Wall in Shaanxi Province (Volume 3), Cultural Relics Press (2015).
[14]
Vent et al., Definition of Structural Damage Patterns: A Structural Damage Atlas Definition of structural damage patterns: a structural atlas. Restoration of Buildings and Monuments; 16(3) (2010):167-185.
[15]
Moreno et al., Vulnerability Study of Earth Walls in Urban Fortifications Using Cause effect Matrixes and GIS: the Case of Seville, Carmona and Estepa Defensive Fences, Mediterr. Archaeol. Archaeom, 19 (2019): 119-138.
[16]
De Falco et al., On the vulnerability of ancient town walls to slow onset events: formulation of a synthetic index (2022).
[17]
Ortiz R, Ortiz P., Vulnerability Index: A New Approach for Preventive Conservation of Monuments. Int. J. of Archit. Herit.; 10(8) (2016): 1078-1100.
[18]
Orihuela Antonio, Molina-Fajardo Maria Aurora, UAV Photogrammetry Surveying for Sustainable Conservation: The Case of Mondujar Castle (Granada, Spain), Sustainability, 13 (1) (2021), p. 24, 10.3390/su13010024.
[19]
Tesse D. Stek, Drones over Mediterranean landscapes. The potential of small UAV's (drones) for site detection and heritage management in archaeological survey projects: A case study from Le Pianelle in the Tappino Valley, Molise (Italy), Journal of Cultural Heritage, 22 (2016), pp. 1066-1071, 10.1016/j.culher.2016.06.006.
[20]
Ulvi Ali, Documentation, Three-Dimensional (3D) Modelling and visualization of cultural heritage by using Unmanned Aerial Vehicle (UAV) photogrammetry and terrestrial laser scanners, International Journal of Remote Sensing, 42 (6) (2021), pp. 1994-2021, 10.1080/01431161.2020.1834164
[21]
Pepe Massimiliano, Costantino Domenica, UAV Photogrammetry and 3D Modelling of Complex Architecture for Maintenance Purposes: the Case Study of the Masonry Bridge on the Sele River, Italy, Periodica Polytechnica-Civil Engineering, 65 (1) (2021), pp.191-203, 10.3311/PPci.16398.
[22]
Frodella William, Elashvili Mikheil, et al., Combining InfraRed Thermography and UAV Digital Photogrammetry for the Protection and Conservation of Rupestrian Cultural Heritage Sites in Georgia: A Methodological Application, Remote Sensing, 12 (5) (2020), pp.1-25, 10.3390/rs12050892
[23]
Spano Antonia, Sammartano Giulia, et al., GIS-based detection of terraced landscape heritage: comparative tests using regional DEMs and UAV data, Applied Geomatics, 10 (2) (2018), pp. 77-97, 10.1007/s12518-018-0205-7.
[24]
Lamas Alberto, Tabik, Siham, et al., MonuMAI: Dataset, deep learning pipeline and citizen science based app for, monumental heritage taxonomy and classification, Neurocomputing, 420(2021), pp. 266-280, 10.1016/j.neucom.2020.09.041.
[25]
Pavoni et al., On Assisting and Automatizing the Semantic Segmentation of Masonry Walls. ACM Journal on Computing and Cultural Heritage (JOCCH), 15(2) (2022), 1-17.
[26]
Wang Haiyan, He Zhongshi, Huang Yongwen, Chen Dingding, Zhou Zexun, Bodhisattva head images modeling style detection of Dazu Rock Carvings based on deep convolutional network, Journal of Cultural Heritage, 27(2017), pp. 60-71, 10.1016/j.culher.2017.03.006.
[27]
Cintas Celia, Lucena Manuel, Fuertes José Manuel, Delrieux Claudio, Navarro Pablo, González-José Rolando, Molinos Manuel, Automatic feature extraction and classification of Iberian ceramics based on deep convolutional networks, Journal of Cultural Heritage, 41(2020), pp. 106-112, 10.1016/j.culher.2019.06.005.
[28]
Zou Zheng, Zhao Xuefeng, Zhao Peng, Qi Fei, Wang Niannian, CNN-based statistics and location estimation of missing components in routine inspection of historic buildings, Journal of Cultural Heritage, (38)2019, pp. 221-230, 10.1016/j.culher.2019.02.002.
[29]
Qi, Charles R., et al., Pointnet: Deep learning on point sets for 3d classification and segmentation, Proceedings of the IEEE conference on computer vision and pattern detection, ( 2017). pp. 652-660. 10.1109/CVPR.2017.16
[30]
Giuliani, F. Ancient Town Walls at Risk: Methods, Technologies, and Tools for Multi-hazard Risk Analysis, Monitoring, and Governance. In Good Practices for Disaster Risk Management of Cultural Heritage (pp. 37-44). Routledge (2023).
[31]
De Falco et al., A BIM-Based Model for Heritage Conservation and Structural Diagnostics: The City Walls of Pisa. In International Conference Florence Heri-Tech: The Future of Heritage Science and Technologies (pp. 84-96). Cham: Springer International Publishing (2022).
[32]
Cudahy Tom, Shi Pilong, Novikova Yulia, Satellite ASTER Mineral Mapping the Provenance of the Loess Used by the Ming to Build their Earthen Great Wall, Remote Sensing, 12 (2) (2020), pp. 1-36, 10.3390/ rs12020270
[33]
Roberto Pierdicca, Mapping Chimu's settlements for conservation purposes using UAV and close range photogrammetry, The virtual reconstruction of Palacio Tschudi, Chan Chan, Peru, (8) 2018, pp.27-34, 10.1016/j.daach.2017.11.004.
[34]
Eisenbeiss Henri, Sauerbier Martin, Investigation of UAV systems and flight modes for photogrammetric applications, Photogrammetric Record, 26 (136) (2011), pp. 400-421, 10.1111/j.1477-9730.2011.00657.x.
[35]
Bewley R H. Aerial survey for archaeology[J]. Photogrammetric Record, 2010, 18(104):273-292. DOI：10.1046/j.0031-868X.2003.00023.x
[36]
Sun S, Wang B. Low-altitude UAV 3D modeling technology in the application of ancient buildings protection situation assessment[J]. Energy Procedia, 2018, 153:320-324. DOI：10.1016/j.egypro.2018.10.082
[37]
Gu Jiuxiang, Wang, Zhenhua, Jason Kuen, Ma Lianyang, et. Al., Recent advances in convolutional neural networks, Pattern Detection, 77(2018), pp. 354–377, 10.1016/j.patcog.2017.10.013.
[38]
He Kaiming, et al., Spatial pyramid pooling in deep convolutional networks for visual detection, European Conference on Computer Vision, (2014), pp.346-361, 10.1007/978-3-319-10578-9_23.
[39]
Simonyan, Karen, Andrew Zisserman. Very deep convolutional networks for large-scale image detection, Computer Science, (2014), pp. 1409-1556, http://www.robots.ox.ac.uk/˜vgg/research/very_deep/.
[40]
Girshick, R., Fast r-cnn. In Proceedings of the IEEE international conference on computer vision (2015) pp. 1440-1448) 10.1109/ICCV.2015.169
[41]
Ren Shaoqing, He Kaiming, Ross Girshick, Sun Jian. Faster r-cnn: Towards real-time object detection with region proposal networks, IEEE transactions on pattern analysis and machine intelligence, (2016, 39), pp. 1137-1149. 10.1109/TPAMI.2016.2577031
[42]
He Kaiming, G. Gkioxari, P. Dollár, R. Girshick, Mask R-CNN, 2017 IEEE International Conference on Computer Vision (2017), pp. 2980-2988, 10.1109/ICCV.2017.322.
[43]
Labelme, http://labelme2.csail.mit.edu/Release3.0/index.php?message=1
[44]
He, Kaiming, Zhang Xiangyu, Ren Shaoqing, Sun Jian, Deep residual learning for image detection, In Proceedings of the IEEE conference on computer vision and pattern detection (2016), pp. 770-778. 10.1109/CVPR.2016.90
[45]
Lin, Tsung-Yi, Piotr Dollár, Ross Girshick, He Kaiming, Bharath Hariharan, Serge Belongie. Feature pyramid networks for object detection, In Proceedings of the IEEE conference on computer vision and pattern detection, (2017), pp. 2117-2125. 10.1109/CVPR.2017.106
[46]
Lin, Tsung-Yi, et al., Microsoft coco: Common objects in context, European conference on computer vision, Springer, Cham, 2014. 10.1007/978-3-319-10602-1_48
[47]
Everingham Mark, Van Gool Luc, et al., The Pascal Visual Object Classes (VOC) Challenge, International Journal of Computer Vision, 88 (2) (2010), pp. 303-338, 10.1007/s11263-009-0275-4.
[48]
Wang N, Zhao Q, Li S, et al., Damage Classification for Masonry Historic Structures Using Convolutional Neural Networks Based on Still Images. Computer-Aided Civil and Infrastructure Engineering, 33(12) (2018): 1073-1089.
[49]
Order No. 476 of the State Council of the people's Republic of China: Regulations on the protection of the Great Wall (2006,09,20). http://www.gov.cn/zwgk/2006-10/23/content_420813.htm
[50]
Chen J, Zhao Y S, Liao A P, et al. Mapping the Ming Great Wall with imagery [C]// Chen J, Jiang J, eds. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.Beijing, 2008：970-973.
[51]
S. Shi, X. Zhou, S. Song, X. Wang, Z. Zhu, X. Huang, X. Jiang, F. Zhou, Z. Guo, L. Xie et al., Towards scalable distributed training of deep learning on public cloud clusters, Proceedings of Machine Learning and Systems, 3 (2021), pp. 401–412. 10.48550/arXiv.2010.10458.
Index Terms
- A Deep Learning-based Method of Investigating Rammed-earth Wall Damage on the Ming Great Wall Military Defense System
Index terms have been assigned to the content through auto-classification.
Recommendations
China great wall digital cultural heritage
Theoretical and Practical Computer Applications in EntertainmentEarly in 2004 the Chinese government established a foundation whose mission is to protect and preserve the Great Wall of China and to articulate the Bo Da Jing Sheng or "profound esteem" that emanates from the 3,000 years of history encompassing the ...
Simulation of terrace wall methane-steam reforming reactors
Terrace wall arrangement is one of the most common arrangements for methane-steam reforming reactor furnaces. In this work, a mathematical model of heat transfer in terrace wall furnaces has been developed. The model has been coupled with a reliable ...
3e Methodology For Tuff Stones As Wall Coating Material
AbstractTuff stones originating from Köyke stone or Isparta volcanic stones have a soft feature (due to high porosity) which can retain natural moisture content when first excavated and their surfaces can be formed. These stones, which have been used in ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
EISSN:1556-4711
Table of ContentsCopyright © 2024 Copyright held by the owner/author(s).
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Online AM: 25 October 2024
Accepted: 04 October 2024
Revised: 20 July 2024
Received: 05 June 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 135Total Downloads
- Downloads (Last 12 months)135
- Downloads (Last 6 weeks)135
Reflects downloads up to 19 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in