TY - JOUR

T1 - Building Bayesian network classifiers through a Bayesian complexity monitoring system

AU - Ruz, G. A.

AU - Pham, D. T.

PY - 2009/3

Y1 - 2009/3

N2 - Nowadays, the need for practical yet efficient machine learning techniques for engineering applications are highly in demand. A new learning method for building Bayesian network classifiers is presented in this article. The proposed method augments the naive Bayesian (NB) classifier by using the Chow and Liu tree construction method, but introducing a Bayesian approach to control the accuracy and complexity of the resulting network, which yields simple structures that are not necessarily a spanning tree. Experiments by using benchmark data sets show that the number of augmenting edges by using the proposed learning method depends on the number of training data used. The classification accuracy was better, or at least equal, to the NB and the tree augmented NB models when tested on 10 benchmark data sets. The evaluation on a real industrial application showed that the simple Bayesian network classifier outperformed the C4.5 and the random forest algorithms and achieved competitive results against C5.0 and a neural network.

AB - Nowadays, the need for practical yet efficient machine learning techniques for engineering applications are highly in demand. A new learning method for building Bayesian network classifiers is presented in this article. The proposed method augments the naive Bayesian (NB) classifier by using the Chow and Liu tree construction method, but introducing a Bayesian approach to control the accuracy and complexity of the resulting network, which yields simple structures that are not necessarily a spanning tree. Experiments by using benchmark data sets show that the number of augmenting edges by using the proposed learning method depends on the number of training data used. The classification accuracy was better, or at least equal, to the NB and the tree augmented NB models when tested on 10 benchmark data sets. The evaluation on a real industrial application showed that the simple Bayesian network classifier outperformed the C4.5 and the random forest algorithms and achieved competitive results against C5.0 and a neural network.

KW - Bayes factor

KW - Bayesian networks

KW - Classification

KW - Naive bayes

KW - Tree-augmented naive bayes classifier

UR - http://www.scopus.com/inward/record.url?scp=63149167438&partnerID=8YFLogxK

U2 - 10.1243/09544062JMES1243

DO - 10.1243/09544062JMES1243

M3 - Article

AN - SCOPUS:63149167438

VL - 223

SP - 743

EP - 756

JO - Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science

JF - Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science

SN - 0954-4062

IS - 3

ER -