Verifying Robustness of Gradient Boosted Models

  • Gil Einziger Nokia Bell Labs
  • Maayan Goldstein Nokia Bell Labs
  • Yaniv Sa’ar Nokia Bell Labs
  • Itai Segall Nokia Bell Labs

Abstract

Gradient boosted models are a fundamental machine learning technique. Robustness to small perturbations of the input is an important quality measure for machine learning models, but the literature lacks a method to prove the robustness of gradient boosted models.

This work introduces VERIGB, a tool for quantifying the robustness of gradient boosted models. VERIGB encodes the model and the robustness property as an SMT formula, which enables state of the art verification tools to prove the model’s robustness. We extensively evaluate VERIGB on publicly available datasets and demonstrate a capability for verifying large models. Finally, we show that some model configurations tend to be inherently more robust than others.

Published
2019-07-17
Section
AAAI Technical Track: Human-AI Collaboration