Bayesian Variable Selection and Model Averaging in High-Dimensional Multinomial Nonparametric Regression

Abstract

AbstractThis article presents a Bayesian method for estimating nonparametrically a highdimensional multinomial regression model. The regression functions are expressed as sums of main effects and interactions and our approach is able to select the significant components entering the model. Each of the main effects and interactions is written as a linear combination of basis terms with a variance components type prior on the regression coefficients. The conditional class probabilities are estimated using both variable selection and model averaging. Our approach can also be used for classification and gives results that are comparable to modern classification methods, but at the same time the results are highly interpretable to the practitioner. All computation is carried out using Markov chain Monte Carlo simulation.Key Words: ClassificationMarkov chain Monte CarloRadial basis functions