The R Journal: article published in 2019, volume 11:2

auditor: an R Package for Model-Agnostic Visual Validation and Diagnostics PDF download
Alicja Gosiewska and Przemysław Biecek , The R Journal (2019) 11:2, pages 85-98.

Abstract Machine learning models have successfully been applied to challenges in applied in biology, medicine, finance, physics, and other fields. With modern software it is easy to train even a complex model that fits the training data and results in high accuracy on test set. However, problems often arise when models are confronted with the real-world data. This paper describes methodology and tools for model-agnostic auditing. It provides functinos for assessing and comparing the goodness of fit and performance of models. In addition, the package may be used for analysis of the similarity of residuals and for identification of outliers and influential observations. The examination is carried out by diagnostic scores and visual verification. The code presented in this paper are implemented in the auditor package. Its flexible and consistent grammar facilitates the validation models of a large class of models.

Received: 2018-12-01; online 2019-08-18, supplementary material, (581 B)
CRAN packages: auditor

CC BY 4.0
This article and supplementary materials are licensed under a Creative Commons Attribution 4.0 International license.

  author = {Alicja Gosiewska and Przemysław Biecek},
  title = {{auditor: an R Package for Model-Agnostic Visual Validation
          and Diagnostics}},
  year = {2019},
  journal = {{The R Journal}},
  doi = {10.32614/RJ-2019-036},
  url = {},
  pages = {85--98},
  volume = {11},
  number = {2}