Title: |
Selective Fusion of Heterogeneous Classifiers |
Author(s): |
G. Tsoumakas, L. Angelis, I. Vlahavas.
|
Availability: |
Click here to download the PDF (Acrobat Reader) file (28 pages).
|
Keywords: |
|
Appeared in: |
Intelligent Data Analysis, IOS Press, 9(6), pp. 511-525, 2005.
|
Abstract: |
There are two main paradigms in combining different classification
algorithms: Classifier Selection and Classifier Fusion. The first
one selects a single model for classifying a new instance, while
the latter combines the decisions of all models. The work
presented in this paper stands in between these two paradigms
aiming tackle the disadvantages and benefit from the advantages of
both. In particular, this paper proposes the use of statistical
procedures for the selection of the best subgroup among different
classification algorithms and the subsequent fusion of the
decision of the models in this subgroup with simple methods like
Weighted Voting. Extensive experimental results show that the
proposed approach, Selective Fusion, improves over simple
selection and fusion methods, leading to performance comparable
with the state-of-the-art heterogeneous classifier combination
method of Stacking, without the additional computational cost and
learning problems of meta-training. |
See also : |
|
This paper has been cited by the following:
1 |
W.W.Y. Ng, A.P.F. Chan, D.S. Yeung, E.C.C. Tsang. "Quantitative study on the generalization error of multiple classifier systems". Proc. 2005 IEEE International Conference on Systems, Man and Cybernetics, pp. 889-894, October 2005. |
2 |
R. Caruana, A. Munson, A Niculescu-Mizil. "Getting the Most Out of Ensemble Selection", Proc. Int. Conf. on Data Mining, pp. 828-833, Hong Kong, 18-22 December, 2006 |
3 |
A. A. Albrecht, A. V. Chashkin, C. S. Iliopoulos, O. M. Kasim-Zade, G. Lappas, and K. Steinhofel. A priori estimation of classification circut complexity. London Algorithmics and Stringology 2006, 97-114, 2007. |
4 |
S. Bian, W. Wang, “On diversity and accuracy of homogeneous and heterogeneous ensembles”, (2007) International Journal of Hybrid Intelligent Systems 4, pp. 103–128. |
|