Certifying machine learning models against evasion attacks by program analysis

Article type: Research Article

Authors: Calzavara, Stefano^{; *} | Ferrara, Pietro | Lucchese, Claudio

Affiliations: Università Ca’ Foscari Venezia, Italy

Correspondence: [*] Corresponding author. E-mail: stefano.calzavara@unive.it.

Abstract: Machine learning has proved invaluable for a range of different tasks, yet it also proved vulnerable to evasion attacks, i.e., maliciously crafted perturbations of inputs designed to force mispredictions. In this article we propose a novel technique to certify the security of machine learning models against evasion attacks with respect to an expressive threat model, where the attacker can be represented by an arbitrary imperative program. Our approach is based on a transformation of the model under attack into an equivalent imperative program, which is then analyzed using the traditional abstract interpretation framework. This solution is sound, efficient and general enough to be applied to a range of different models, including decision trees, logistic regression and neural networks. Our experiments on publicly available datasets show that our technique yields only a minimal number of false positives and scales up to cases which are intractable for a competitor approach.

Keywords: Adversarial machine learning, abstract interpretation, evasion attacks, security certification

DOI: 10.3233/JCS-210133

Journal: Journal of Computer Security, vol. 31, no. 1, pp. 57-84, 2023