关键词: 信息提取,网页结构,相似度,树路径模型,聚类

Abstract: Computing the similarity is the basis of text mining,and also the crucial step of information extraction.When tackling the Web pages with complex structure,the accuracy of computing the similarity based on traditional tree path model is not perfect.Traditional tree path model will not take the sequence of the paths in consideration and compare the similarity of paths by using perfect matching.It cannot describe the similarity between paths accurately when it is not a perfect matching.Therefore,the paper introduced the structural similarity Web at first,and then proposed a tree path model.This model takes fully account of the relationship between the siblings,the path location and the path weights,and makes up for the defect of the traditional tree path model which cannot express both document structure and hierarchical information.The experiment result shows that the model improves the recognition ability of Web pages structural similarity.It not only can better distinguish the Web pages which have large structure difference,but also effectively reflects the difference between the Web pages with the same template,also has a better effect in the Web page clustering.

Key words: Information extraction,Web page structure,Similarity,Tree path model,Clustering