Corani, Giorgio and Antonucci, Alessandro (2014) Credal Ensembles of Classifiers. Computational Statistics & Data Analysis, 71. pp. 818-831. ISSN 0167-9473
Text
corani2012f.pdf - Accepted Version Download (337kB) |
Abstract
It is studied how to aggregate the probabilistic predictions generated by different SPODE (Super-Parent-One-Dependence Estimators) classifiers. It is shown that aggregating such predictions via compression-based weights achieves a slight but consistent improvement of performance over previously existing aggregation methods, including Bayesian Model Averaging and simple average (the approach adopted by the AODE algorithm). Then, attention is given to the problem of choosing the prior probability distribution over the models; this is an important issue in any Bayesian ensemble of models. To robustly deal with the choice of the prior, the single prior over the models is substituted by a set of priors over the models (credal set), thus obtaining a credal ensemble of Bayesian classifiers. The credal ensemble recognizes the prior-dependent instances, namely the instances whose most probable class varies when different prior over the models are considered. When faced with prior-dependent instances, the credal ensemble remains reliable by returning a set of classes rather than a single class. Two credal ensembles of SPODEs are developed; the first generalizes the Bayesian Model Averaging and the second the compression-based aggregation. Extensive experiments show that the novel ensembles compare favorably to traditional methods for aggregating SPODEs and also to previous credal classifiers.
Item Type: | Scientific journal article, Newspaper article or Magazine article |
---|---|
Uncontrolled Keywords: | Classification; Bayesian model averaging; Compression-based averaging; AODE; Credal classification; Imprecise probability; Credal ensemble |
Subjects: | Mathematical sciences > Statistics > Statistical modelling Computer sciences > Artificial intelligence > Machine learning |
Department/unit: | Dipartimento tecnologie innovative > Istituto Dalle Molle di studi sull’intelligenza artificiale USI-SUPSI |
Depositing User: | Giorgio Corani |
Date Deposited: | 14 Mar 2014 07:43 |
Last Modified: | 19 May 2016 11:55 |
URI: | http://repository.supsi.ch/id/eprint/4249 |
Actions (login required)
View Item |