Last updated on 2025-12-28 01:49:18 CET.
| Package | ERROR | OK |
|---|---|---|
| mlr3fairness | 1 | 12 |
Current CRAN status: ERROR: 1, OK: 12
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in 'mlr3fairness-Ex.R' failed
The error most likely occurred in:
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:11:14.025] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:11:14.233] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:11:14.290] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:11:14.335] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:11:14.401] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:11:14.467] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.4.0
Check: tests
Result: ERROR
Running 'testthat.R' [16s]
Running the tests in 'tests/testthat.R' failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building 'debiasing-vignette.Rmd' using rmarkdown
INFO [17:11:39.494] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:11:39.686] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:11:39.877] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:11:40.013] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:11:40.165] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:11:40.559] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:11:40.956] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:11:41.348] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building 'debiasing-vignette.Rmd'
--- re-building 'measures-vignette.Rmd' using rmarkdown
INFO [17:11:48.809] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:11:48.955] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:12:10.272] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:12:31.903] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:12:53.365] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:12:53.696] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:12:53.977] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:12:54.247] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building 'measures-vignette.Rmd'
--- re-building 'reports-vignette.Rmd' using rmarkdown
INFO [17:12:58.612] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:12:58.820] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:12:58.929] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:12:58.976] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:12:59.017] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:12:59.058] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building 'reports-vignette.Rmd'
--- re-building 'visualization-vignette.Rmd' using rmarkdown
INFO [17:13:07.424] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:13:07.855] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:13:09.751] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:13:11.700] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:13:13.560] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:13:13.647] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:13:13.717] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:13:13.773] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building 'visualization-vignette.Rmd'
SUMMARY: processing the following files failed:
'debiasing-vignette.Rmd' 'measures-vignette.Rmd'
'reports-vignette.Rmd' 'visualization-vignette.Rmd'
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-windows-x86_64
These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.