A Method of Web Page Classification Based on Feature Dimension Reduction

Abstract

Text classification technology to quickly retrieve information pages, information filtering and data mining provides an important foundation. Due to the diversity and complexity of web page format, the problem of web page classification is more difficult to deal with than text classification. This paper on web page classification method research, through the improvement of bloom filter, after pretreatment of the text content of pages, the improved bloom filter used in filtering feature set, greatly reducing the feature dimension, then according to the characteristics of web page, the feature weight algorithm has been improved. Finally, using the naive Bayesian classifier can verify the effectiveness of the algorithm.