Bayesian Model Selection for Support Vector Machines, Gaussian Processes and Other Kernel Classifiers

• Presented at: Neural Information Processing Systems 12, Denver, CO
• Published in: Proceedings of the 13th Annual Conference on Neural Information Processing Systems, p. 603-609
• Publication date: 2000

We present a variational Bayesian method for model selection over families of kernels classifiers like Support Vector machines or Gaussian processes. The algorithm needs no user interaction and is able to adapt a large number of kernel parameters to given data without having to sacrifice training cases for validation. This opens the possibility to use sophisticated families of kernels in situations where the small ``standard kernel'' classes are clearly inappropriate. We relate the method to other work done on Gaussian processes and clarify the relation between Support Vector machines and certain Gaussian process models.

Keywords: Gaussian process ; Support vector machine ; Variational inference ; Bayesian learning

Reference

• EPFL-CONF-161324

Record created on 2010-12-02, modified on 2016-08-09