Predictive Subset Selection using Regression Trees and RBF Neural Networks Hybridized with the Genetic Algorithm

Authors

  • Oguz Akbilgic Istanbul University
  • Hamparsum Bozdogan

Keywords:

Model Selection, Subset Selection, Information Criteria, Radial Basis Functions, Neural Networks

Abstract

In this paper we develop a novel nonparametric predictive subset regression modeling procedure that involves a combination of regression trees with radial basis function (RBF) neural networks hybridized with the genetic algorithm (GA) to carry out the subset selection of the best predictors. We use the information-theoretic measure of complexity (ICOMP) criterion of [5, 6, 7, 8] as our fitness function to choose the best approximating radial basis functions and to choose the best subset of predictors with the GA. To avoid the potential singularities in the design matrix, we combine our model with analytical global ridge regression for regularization. On the other hand, estimation and prediction performance of model also taken into account for best subset chosen.

Downloads

Published

2011-11-27

Issue

Vol. 4 No. 4: (October 2011)

Section

Econometrics and Statistics

License

Upon acceptance of an article by the European Journal of Pure and Applied Mathematics, the author(s) retain the copyright to the article. However, by submitting your work, you agree that the article will be published under the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). This license allows others to copy, distribute, and adapt your work, provided proper attribution is given to the original author(s) and source. However, the work cannot be used for commercial purposes.

By agreeing to this statement, you acknowledge that:

  • You retain full copyright over your work.
  • The European Journal of Pure and Applied Mathematics will publish your work under the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).
  • This license allows others to use and share your work for non-commercial purposes, provided they give appropriate credit to the original author(s) and source.

How to Cite

Predictive Subset Selection using Regression Trees and RBF Neural Networks Hybridized with the Genetic Algorithm. (2011). European Journal of Pure and Applied Mathematics, 4(4), 467-485. https://www.ejpam.com/index.php/ejpam/article/view/1375