Earticle

초록

영어

With the explosive growth of the information on the Internet, the number of web pages is also expanding rapidly. A common web page typically contains many different blocks. Unfortunately, apart from the main content blocks, it usually has such blocks as navigation bars, copyright, and advertisements, which are known as noise. Studies have shown that these noisy blocks can do harm to Web mining, search engine performance, and Web page clustering and classification. It is a significant work to effectively clean these noises up and extract main content blocks from the Web pages. In this paper, we propose a method of automatic template detection and noise elimination based on an new idea defining two sorts of templates called Style Template and Content Template relatively. There is a basic observation that, the Web pages from the same site are always similar in presentation style and contents, however, the main content blocks are always different in contents. Therefore, we design an algorithm to detect the two kind of templates from the samplings from a particular site, and extract the main content out of the noises using the template. We apply our method to template problem, and the result shows that our methods performs very well, and has a remarkable advantage on time consumption over previous methods.

목차

Abstract
 1. Introduction
 2. Related Work
 3. Proposed Method
  3.1. DOM Tree
  3.2. Our Algorithm
  3.3. Web Page Cleaning
  3.4. The Dynamic Threshold
 4. Experimentation
  4.1. Data sets
  4.2. Template Detection
 5. Conclusions
 References

키워드

저자

• Xiangang Zuo [ Department of Information Engineering, Henan Institute of Science and Technology, Xinxiang, 453003,China ]
• Zhixia Zhang [ Department of Information Engineering, Henan Institute of Science and Technology, Xinxiang, 453003,China ]
• Jianping Xie [ Institute of Technology, Lishui University, Lishui 323000, China ] Corresponding author

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  International Journal of Hybrid Information Technology

• 간기

  격월간

• pISSN

  1738-9968

• 수록기간

  2008~2016

• 십진분류

  KDC 505 DDC 605