Abstract
The hierarchical structure of a document plays an important role in understanding the relationships between its contents. However, such a structure is not always explicitly represented in web documents through available html hierarchical tags. Headings however, are usually differentiated from ‘normal’ text in a document in terms of presentation thus providing an implicit structure discernable by a human reader. As such, an important pre-processing step for applications that need to operate on the hierarchical level is to extract the implicitly represented hierarchal structure. In this paper, an algorithm for heading detection and heading level detection which makes use of various visual presentations is presented. Results of evaluating this algorithm are also reported.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Goecke, D., Witt, A.: Exploiting logical document structure for anaphora resolution. In: Proceedings of LREC 2006 Conference, Genoa, Italy (2006)
El-Beltagy, S., Rafea, A., Abdelhamid, Y.: Using Dynamically Acquired Background Knowledge For Information Extraction And Intelligent Search. In: Mohammadian, M. (ed.) Intelligent Agents for Data Mining and Information Retrieval, pp. 196–207. Idea Group Publishing, Hershey (2004)
Tatsumi, Y., Asahi, T.: Analyzing web page headings considering various presentations. In: Proceedings of 14th international conference on World Wide Web, Chiba, Japan (2005)
Diao, Y., Lu, H., Chen, S., Tian, Z.: Toward Learning Based Web Query Processing. In: Proceedings of International Conference on Very Large Databases, Cairo, Egypt, pp. 317–328 (2000)
Cai, D., Yu, S., Wen, J.R., Ma, W.Y.: Extracting content structure for web pages based on visual representation. In: Proceedings of the 5th Asia Pacific Web Conference, Xi’an, China (2003)
Mehta, R., Mitra, P., Karnick, H.: Extracting Semantic Structure of Web Documents Using Content and Visual Information. In: Proceedings of the 14th international conference on World Wide Web, Chiba, Japan (2005)
Mukherjee, S., Yang, G., Ramakrishnan, I.V.: Automatic annotation of content-rich HTML documents: Structural and semantic analysis. In: Fensel, D., Sycara, K.P., Mylopoulos, J. (eds.) ISWC 2003. LNCS, vol. 2870, pp. 533–549. Springer, Heidelberg (2003)
HTML 4.01 Specification, http://www.w3.org/TR/REC-html40/
Baluja, S.: Browsing on small screens: recasting web-page segmentation into an efficient machine learning framework. In: Proceedings of the 15th international conference on World Wide Web, Edinburgh, Scotland (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
El-Shayeb, M.A., El-Beltagy, S.R., Rafea, A. (2009). Extracting the Latent Hierarchical Structure of Web Documents. In: Damiani, E., Yetongnon, K., Chbeir, R., Dipanda, A. (eds) Advanced Internet Based Systems and Applications. SITIS 2006. Lecture Notes in Computer Science, vol 4879. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01350-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-01350-8_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01349-2
Online ISBN: 978-3-642-01350-8
eBook Packages: Computer ScienceComputer Science (R0)