Low Bias Bagged Support Vector Machines

Giorgio Valentini and Thomas G. Dietterich

Theoretical and experimental analyses bagging indicate that it is primarily a variance reduction technique. This suggests that bagging should be applied to learning algorithms tuned to minimize bias, even at cost of some increase in variance. We test idea with Support Vector Machines (SVMs) by employing out-of-bag estimates of and variance to tune the SVMs. Experiments indicate that bagging of low-bias SVMs "lobag" algorithm) never hurts generalization performance and often improves it compared with well-tuned single SVMs and bags of individually well-tuned SVMs.


This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.