Random vector functional link with naive bayes for classification problems of mixed data

Gonzalo A. Ruz, Pablo A. Henriquez

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

A common approach to handle categorical attributes in neural networks is to use the one-hot encoding. Depending of the number of categorical attributes, and the number of levels that each one of these can have, will increase significantly the number of input nodes of a neural network. In this paper we analyze a type of randomized neural network called random vector functional link which has a non-iterative learning approach, in particular, it can be trained in one step. In order to avoid any time consuming preprocessing for categorical attributes, or increase the dimensionality of the input layer of the neural network, we propose a two-stage learning approach. In the first stage, we use the naive Bayes, that is also trained in one step, to compute the posterior probabilities for each class, using all the attributes. Then, in the second stage, we train a random vector functional link using as inputs the continuous attributes and including as additional hidden units the posterior probabilities obtained in the previous stage. We compare using benchmark datasets, the classification performance of the neural network with only continuous attributes versus the combination with naive Bayes to include the information of the categorical data. The experimental results show the effectiveness of the proposed approach for mixed data handling in random vector functional link networks.

Original languageEnglish
Title of host publicationProceedings - IEEE 31st International Conference on Tools with Artificial Intelligence, ICTAI 2019
PublisherIEEE Computer Society
Pages1749-1752
Number of pages4
ISBN (Electronic)9781728137988
DOIs
StatePublished - Nov 2019
Externally publishedYes
Event31st IEEE International Conference on Tools with Artificial Intelligence, ICTAI 2019 - Portland, United States
Duration: 4 Nov 20196 Nov 2019

Publication series

NameProceedings - International Conference on Tools with Artificial Intelligence, ICTAI
Volume2019-November
ISSN (Print)1082-3409

Conference

Conference31st IEEE International Conference on Tools with Artificial Intelligence, ICTAI 2019
Country/TerritoryUnited States
CityPortland
Period4/11/196/11/19

Keywords

  • Classification
  • Mixed data
  • Naive Bayes
  • Random vector functional link

Fingerprint

Dive into the research topics of 'Random vector functional link with naive bayes for classification problems of mixed data'. Together they form a unique fingerprint.

Cite this