A new soft set based pruning algorithm for ensemble method

Mohd Khalid, Awang and Mohd Nordin, Abdul Rahman and Mokhairi, Makhtar (2016) A new soft set based pruning algorithm for ensemble method. Journal of Theoretical and Applied Information Technology, 88 (3). pp. 384-391. ISSN 19928645 [P]

Image FH02-FIK-16-06166.jpg Restricted to Registered users only Download (182kB) | Request a copy

Abstract

Ensemble methods have been introduced as a useful and effective solution to improve the performance of the classification. Despite having the ability of producing the highest classification accuracy, ensemble methods have suffered significantly from their large volume of base classifiers. Nevertheless, we could overcome this problem by pruning some of the classifiers in the ensemble repository. However, only a few researches focused on the ensemble pruning algorithm. Therefore, this paper aims to increase classification accuracy and at the same time minimizing ensemble classifiers by constructing a new ensemble pruning method (SSPM) based on dimensionality reduction in soft set theory. Ensemble pruning deals with the reduction of predictive models in order to improve its efficiency and predictive performance. Soft set theory has been proved to be an effective mathematical tool for dimension reduction. Thus, we proposed a novel soft set based method to prune the classifiers from heterogeneous ensemble committee and select the best subsets of the component classifiers prior to the combination process. The results show that the proposed method not only reduce the number of members of the ensemble, but able to produce highest prediction accuracy.

Actions (login required)

View Item