Package: auditor 1.3.5

Alicja Gosiewska

auditor: Model Audit - Verification, Validation, and Error Analysis

Provides an easy to use unified interface for creating validation plots for any model. The 'auditor' helps to avoid repetitive work consisting of writing code needed to create residual plots. This visualizations allow to asses and compare the goodness of fit, performance, and similarity of models.

Authors:Alicja Gosiewska [aut, cre], Przemyslaw Biecek [aut, ths], Hubert Baniecki [aut], Tomasz Mikołajczyk [aut], Michal Burdukiewicz [ctb], Szymon Maksymiuk [ctb]

auditor_1.3.5.tar.gz
auditor_1.3.5.zip(r-4.7)auditor_1.3.5.zip(r-4.6)auditor_1.3.5.zip(r-4.5)
auditor_1.3.5.tgz(r-4.6-any)auditor_1.3.5.tgz(r-4.5-any)
auditor_1.3.5.tar.gz(r-4.7-any)auditor_1.3.5.tar.gz(r-4.6-any)
auditor_1.3.5.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
auditor/json (API)

# Install 'auditor' in R:
install.packages('auditor', repos = c('https://modeloriented.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/modeloriented/auditor/issues

Datasets:

On CRAN:

Conda:

classificationerror-analysisexplainable-artificial-intelligencemachine-learningmodel-validationregression-modelsresidualsxai

9.11 score 60 stars 2 packages 104 scripts 2.0k downloads 111 exports 36 dependencies

Last updated from:1f2fdc1250. Checks:9 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-x86_64OK237
source / vignettesOK257
linux-release-x86_64OK194
macos-release-arm64OK160
macos-oldrel-arm64OK127
windows-develOK163
windows-releaseOK173
windows-oldrelOK160
wasm-releaseOK106

Exports:auditcheck_residualscheck_residuals_autocorrelationcheck_residuals_outlierscheck_residuals_trendmodel_cooksdistancemodel_evaluationmodel_halfnormalmodel_performancemodel_residualmodelEvaluationmodelFitmodelPerformancemodelResidualsobservationInfluenceplot_acfplot_auditorplot_autocorrelationplot_cooksdistanceplot_correlationplot_halfnormalplot_liftplot_pcaplot_prcplot_predictionplot_radarplot_recplot_residualplot_residual_boxplotplot_residual_densityplot_rocplot_rrocplot_scalelocationplot_tsecdfplotACFplotAutocorrelationplotCooksDistanceplotD3plotD3_acfplotD3_autocorrelationplotD3_cooksdistanceplotD3_halfnormalplotD3_liftplotD3_predictionplotD3_recplotD3_residualplotD3_rocplotD3_rrocplotD3_scalelocationplotD3ACFplotD3AutocorrelationplotD3CooksDistanceplotD3HalfNormalplotD3LIFTplotD3PredictionplotD3RECplotD3ResidualplotD3ScaleLocationplotHalfNormalplotLIFTplotModelCorrelationplotModelPCAplotModelRankingplotPredictionplotRECplotResidualplotResidualBoxplotplotResidualDensityplotROCplotRROCplotScaleLocationplotTwoSidedECDFscorescore_accscore_aucscore_auprcscore_cooksdistancescore_dwscore_f1score_giniscore_halfnormalscore_maescore_msescore_one_minus_accscore_one_minus_aucscore_one_minus_auprcscore_one_minus_f1score_one_minus_giniscore_one_minus_precisionscore_one_minus_recallscore_one_minus_specificityscore_peakscore_precisionscore_r2score_recscore_recallscore_rmsescore_rrocscore_runsscore_specificityscoreCooksDistancescoreDWscoreHalfNormalscoreMAEscoreMSEscorePeakscoreRECscoreRMSEscoreROCscoreRROCscoreRuns

Dependencies:clicodetoolscpp11DALEXdigestdoFuturefarverforeachfuturefuture.applyggplot2ggrepelglobalsgluegridExtragtablehnpiBreakDowningredientsisobanditeratorskernelshaplabelinglifecyclelistenvMASSparallellyR6RColorBrewerRcpprlangS7scalesvctrsviridisLitewithr

Model performance audit
Data | Models | Preparation for analysis of performance | Model ranking radar plot | Other methods
Rendered frommodel_performance_audit.Rmdusingknitr::knitr

Last update: 2021-07-26
Started: 2018-07-17

Model residuals audit
Data | Models | Preparation for residual (error) analysis | Plots | Observed vs predicted | Residuals vs observed, fitted or variable values | Density of residuals | Boxplot of residuals | Autocorrelation function of residuals | Autocorrelation of residuals | Correlation of models | Principal component analysis (PCA) of models | Regression error characteristic curve (REC) | Regression receiver operating characteristic (RROC) | Scale location | Two-sided empirical cumulative distribution function (TSECDF) | Other methods
Rendered frommodel_residuals_audit.Rmdusingknitr::knitr

Last update: 2021-07-26
Started: 2018-07-22

Observation influence audit
Data | Models | Preparation for analysis of observation influence | Plot of Cook's distances | Other methods
Rendered fromobservation_influence_audit.Rmdusingknitr::knitr

Last update: 2021-07-26
Started: 2018-07-22

Model evaluation audit
Data | Models | Preparation for evaluation analysis | Plots | Receiver operating characteristic (ROC) | LIFT chart | Other methods
Rendered frommodel_evaluation_audit.Rmdusingknitr::knitr

Last update: 2021-07-19
Started: 2018-07-23

Model fit audit
Use-case - regression problem | Half-normal plot | Binomial model | Use-cases (classification) | Other methods | References
Rendered frommodel_fit_audit.Rmdusingknitr::knitr

Last update: 2021-07-19
Started: 2018-07-22

Readme and manuals

Help Manual

Help pageTopics
Deprecatedaudit
Artificial auditorDataauditorData
Automated tests for model residualscheck_residuals
Checks for autocorrelation in target variable or in residualscheck_residuals_autocorrelation
Checks for outlierscheck_residuals_outliers
Checks for trend in residualscheck_residuals_trend
Cook's distancesmodel_cooksdistance observationInfluence
Create model evaluation explanationmodelEvaluation model_evaluation
Create Halfnormal ExplanationmodelFit model_halfnormal
Create Model Performance ExplanationmodelPerformance model_performance
Create Model Residuals ExplanationmodelResiduals model_residual
Autocorrelation Function PlotplotACF plot_acf
Model Diagnostic Plotsplot.auditor_model_cooksdistance plot.auditor_model_evaluation plot.auditor_model_halfnormal plot.auditor_model_performance plot.auditor_model_residual plot_auditor
Autocorrelation of Residuals PlotplotAutocorrelation plot_autocorrelation
Influence of Observations PlotplotCooksDistance plot_cooksdistance
Correlation of Model's Residuals PlotplotModelCorrelation plot_correlation
Half-Normal plotplotHalfNormal plot_halfnormal
LIFT ChartplotLIFT plot_lift
Principal Component Analysis of modelsplotModelPCA plot_pca
Precision-Recall Curve (PRC)plotROC plot_prc plot_roc
Predicted response vs Observed or Variable ValuesplotPrediction plot_prediction
Model Ranking PlotplotModelRanking plot_radar
Regression Error Characteristic Curves (REC)plotREC plot_rec
Plot Residuals vs Observed, Fitted or Variable ValuesplotResidual plot_residual
Plot Boxplots of ResidualsplotResidualBoxplot plot_residual_boxplot
Residual Density PlotplotResidualDensity plot_residual_density
Regression Receiver Operating Characteristic (RROC)plotRROC plot_rroc
Scale location plotplotScaleLocation plot_scalelocation
Two-sided Cumulative Distribution FunctionplotTwoSidedECDF plot_tsecdf
Model Diagnostic Plots in D3 with r2d3 package.plotD3 plotD3.auditor_model_cooksdistance plotD3.auditor_model_evaluation plotD3.auditor_model_halfnormal plotD3.auditor_model_residual plotD3_auditor
Plot Autocorrelation Function in D3 with r2d3 package.plotD3ACF plotD3_acf
Autocorrelation Plot in D3 with r2d3 package.plotD3Autocorrelation plotD3_autocorrelation
Influence of observations Plot in D3 with r2d3 package.plotD3CooksDistance plotD3_cooksdistance
Plot Half-Normal in D3 with r2d3 package.plotD3HalfNormal plotD3_halfnormal
Plot LIFT in D3 with r2d3 package.plotD3LIFT plotD3_lift
Plot Prediction vs Target, Observed or Variable Values in D3 with r2d3 package.plotD3Prediction plotD3_prediction
Regression Error Characteristic Curves (REC) in D3 with r2d3 package.plotD3REC plotD3_rec
Plot Residuals vs Observed, Fitted or Variable Values in D3 with r2d3 package.plotD3Residual plotD3_residual
Receiver Operating Characteristic (ROC) in D3 with r2d3 package.plotD3_roc
Regression Receiver Operating Characteristic (RROC) in D3 with r2d3 package.plotD3_rroc
Scale Location Plot in D3 with r2d3 package.plotD3ScaleLocation plotD3_scalelocation
Prints Model Cook's Distances Summaryprint.auditor_model_cooksdistance
Prints Model Evaluation Summaryprint.auditor_model_evaluation
Prints Model Halfnormal Summaryprint.auditor_model_halfnormal
Prints Model Performance Summaryprint.auditor_model_performance
Prints Model Residual Summaryprint.auditor_model_residual
Prints of Models Scoresprint.auditor_score
Model Scores computationsscore
Accuracyscore_acc
Area Under ROC Curve (AUC)scoreROC score_auc
Area under precision-recall curvescore_auprc
Score based on Cooks DistancescoreCooksDistance score_cooksdistance
Durbin-Watson ScorescoreDW score_dw
F1 Scorescore_f1
Gini Coefficientscore_gini
Half-Normal ScorescoreHalfNormal score_halfnormal
Mean Absolute ErrorscoreMAE score_mae
Mean Square ErrorscoreMSE score_mse
One minus accuracyscore_one_minus_acc
One minus Area Under ROC Curve (AUC)score_one_minus_auc
One Minus area under precision-recall curvescore_one_minus_auprc
One Minus F1 Scorescore_one_minus_f1
One minus Gini Coefficientscore_one_minus_gini
One Minus Precisionscore_one_minus_precision
One minus recallscore_one_minus_recall
One minus specificityscore_one_minus_specificity
Peak ScorescorePeak score_peak
Precisionscore_precision
R-squaredscore_r2
Area Over the Curve for REC CurvesscoreREC score_rec
Recallscore_recall
Root Mean Square ErrorscoreRMSE score_rmse
Area Over the Curve for RROC CurvesscoreRROC score_rroc
Runs ScorescoreRuns score_runs
Specificityscore_specificity