Last updated on 2025-12-12 21:50:00 CET.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.1.7 | 6.54 | 84.07 | 90.61 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.1.7 | 4.69 | 59.75 | 64.44 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.1.7 | 12.00 | 127.01 | 139.01 | ERROR | |
| r-devel-linux-x86_64-fedora-gcc | 0.1.7 | 11.00 | 116.14 | 127.14 | ERROR | |
| r-devel-windows-x86_64 | 0.1.7 | 9.00 | 83.00 | 92.00 | ERROR | |
| r-patched-linux-x86_64 | 0.1.7 | 6.13 | 74.13 | 80.26 | ERROR | |
| r-release-linux-x86_64 | 0.1.7 | 6.07 | 74.71 | 80.78 | ERROR | |
| r-release-macos-arm64 | 0.1.7 | OK | ||||
| r-release-macos-x86_64 | 0.1.7 | 4.00 | 59.00 | 63.00 | OK | |
| r-release-windows-x86_64 | 0.1.7 | 8.00 | 83.00 | 91.00 | OK | |
| r-oldrel-macos-arm64 | 0.1.7 | OK | ||||
| r-oldrel-macos-x86_64 | 0.1.7 | 4.00 | 71.00 | 75.00 | OK | |
| r-oldrel-windows-x86_64 | 0.1.7 | 11.00 | 105.00 | 116.00 | ERROR |
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [04:30:32.783] [mlr3] Running benchmark with 36 resampling iterations
INFO [04:30:32.845] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [04:30:32.905] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [04:30:32.936] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [04:30:33.033] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [04:30:33.072] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [04:30:33.111] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [04:30:33.149] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [04:30:33.215] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [04:30:33.268] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [04:30:33.326] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [04:30:33.360] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [04:30:33.393] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [04:30:33.426] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [04:30:33.493] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [04:30:33.546] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [04:30:33.606] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [04:30:33.716] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [04:30:33.833] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [04:30:33.928] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [04:30:33.957] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [04:30:33.985] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [04:30:34.018] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [04:30:34.056] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [04:30:34.093] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [04:30:34.131] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [04:30:34.189] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [04:30:34.246] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [04:30:34.302] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [04:30:34.340] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [04:30:34.404] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [04:30:34.435] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [04:30:34.474] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [04:30:34.514] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [04:30:34.553] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [04:30:34.627] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [04:30:34.692] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [04:30:34.778] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [17:08:10.121] [mlr3] Running benchmark with 36 resampling iterations
INFO [17:08:10.142] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [17:08:10.185] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [17:08:10.228] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [17:08:10.295] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [17:08:10.353] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [17:08:10.382] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [17:08:10.410] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [17:08:10.496] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [17:08:10.570] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [17:08:10.645] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [17:08:10.669] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [17:08:10.710] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [17:08:10.756] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [17:08:10.811] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [17:08:10.855] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [17:08:10.936] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [17:08:11.102] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [17:08:11.185] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [17:08:11.285] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [17:08:11.342] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [17:08:11.407] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [17:08:11.455] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [17:08:11.491] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [17:08:11.518] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [17:08:11.559] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [17:08:11.639] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [17:08:11.685] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [17:08:11.728] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [17:08:11.769] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [17:08:11.826] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [17:08:11.896] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [17:08:11.926] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [17:08:11.955] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [17:08:11.981] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [17:08:12.073] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [17:08:12.158] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [17:08:12.250] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [09:56:14.113] [mlr3] Running benchmark with 36 resampling iterations
INFO [09:56:14.167] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [09:56:14.271] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [09:56:14.379] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [09:56:14.554] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [09:56:14.798] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [09:56:14.990] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [09:56:15.205] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [09:56:15.373] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [09:56:15.563] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [09:56:15.848] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [09:56:16.033] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [09:56:16.087] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [09:56:16.142] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [09:56:16.251] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [09:56:16.738] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [09:56:17.014] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [09:56:17.504] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [09:56:18.322] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [09:56:18.507] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [09:56:18.617] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [09:56:18.699] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [09:56:18.775] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [09:56:18.906] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [09:56:19.058] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [09:56:19.206] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [09:56:19.361] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [09:56:19.745] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [09:56:19.985] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [09:56:20.063] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [09:56:20.198] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [09:56:20.243] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [09:56:20.502] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [09:56:20.584] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [09:56:20.716] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [09:56:20.886] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [09:56:21.060] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [09:56:21.350] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [00:47:12.014] [mlr3] Running benchmark with 36 resampling iterations
INFO [00:47:12.169] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [00:47:12.542] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [00:47:12.854] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [00:47:13.076] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [00:47:13.900] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [00:47:13.972] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [00:47:14.123] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [00:47:15.883] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [00:47:16.044] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [00:47:16.155] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [00:47:16.231] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [00:47:16.307] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [00:47:16.433] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [00:47:16.624] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [00:47:16.781] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [00:47:17.248] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [00:47:17.851] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [00:47:18.565] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [00:47:19.561] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [00:47:19.769] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [00:47:20.010] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [00:47:20.269] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [00:47:20.518] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [00:47:20.707] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [00:47:21.001] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [00:47:21.294] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [00:47:21.689] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [00:47:21.941] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [00:47:22.041] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [00:47:22.249] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [00:47:22.384] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [00:47:22.539] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [00:47:22.765] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [00:47:22.984] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [00:47:23.423] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [00:47:23.841] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [00:47:24.264] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in 'mlr3benchmark-Ex.R' failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [17:36:26.611] [mlr3] Running benchmark with 36 resampling iterations
INFO [17:36:26.639] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [17:36:26.682] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [17:36:26.722] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [17:36:26.759] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [17:36:26.803] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [17:36:26.846] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [17:36:26.887] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [17:36:26.984] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [17:36:27.066] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [17:36:27.142] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [17:36:27.174] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [17:36:27.210] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [17:36:27.248] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [17:36:27.316] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [17:36:27.364] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [17:36:27.413] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [17:36:27.518] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [17:36:27.598] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [17:36:27.690] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [17:36:27.732] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [17:36:27.765] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [17:36:27.797] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [17:36:27.828] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [17:36:27.861] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [17:36:27.899] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [17:36:27.982] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [17:36:28.070] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [17:36:28.121] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [17:36:28.147] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [17:36:28.178] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [17:36:28.212] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [17:36:28.252] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [17:36:28.310] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [17:36:28.358] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [17:36:28.462] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [17:36:28.554] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [17:36:28.673] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [16:04:29.336] [mlr3] Running benchmark with 36 resampling iterations
INFO [16:04:29.374] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [16:04:29.450] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [16:04:29.522] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [16:04:29.588] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [16:04:29.667] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [16:04:29.718] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [16:04:29.778] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [16:04:29.922] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [16:04:30.067] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [16:04:30.171] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [16:04:30.205] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [16:04:30.236] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [16:04:30.296] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [16:04:30.432] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [16:04:30.533] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [16:04:30.633] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [16:04:30.842] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [16:04:31.038] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [16:04:31.245] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [16:04:31.326] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [16:04:31.389] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [16:04:31.449] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [16:04:31.523] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [16:04:31.594] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [16:04:31.669] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [16:04:31.800] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [16:04:31.956] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [16:04:32.089] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [16:04:32.166] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [16:04:32.243] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [16:04:32.313] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [16:04:32.394] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [16:04:32.511] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [16:04:32.592] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [16:04:32.762] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [16:04:32.919] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [16:04:33.160] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-patched-linux-x86_64
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [15:53:10.230] [mlr3] Running benchmark with 36 resampling iterations
INFO [15:53:10.263] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [15:53:10.322] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [15:53:10.410] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [15:53:10.486] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [15:53:10.552] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [15:53:10.599] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [15:53:10.636] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [15:53:10.748] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [15:53:10.825] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [15:53:10.898] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [15:53:10.949] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [15:53:11.019] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [15:53:11.054] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [15:53:11.167] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [15:53:11.226] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [15:53:11.282] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [15:53:11.479] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [15:53:11.639] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [15:53:11.770] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [15:53:11.836] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [15:53:11.895] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [15:53:11.956] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [15:53:12.019] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [15:53:12.056] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [15:53:12.127] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [15:53:12.251] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [15:53:12.374] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [15:53:12.486] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [15:53:12.546] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [15:53:12.595] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [15:53:12.657] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [15:53:12.715] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [15:53:12.753] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [15:53:12.819] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [15:53:12.970] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [15:53:13.121] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [15:53:13.258] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-release-linux-x86_64
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in 'mlr3benchmark-Ex.R' failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [16:43:10.373] [mlr3] Running benchmark with 36 resampling iterations
INFO [16:43:10.416] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [16:43:10.466] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [16:43:10.514] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [16:43:10.564] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [16:43:10.617] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [16:43:10.674] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [16:43:10.731] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [16:43:10.878] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [16:43:10.993] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [16:43:11.100] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [16:43:11.149] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [16:43:11.194] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [16:43:11.241] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [16:43:11.328] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [16:43:11.418] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [16:43:11.494] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [16:43:11.644] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [16:43:11.791] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [16:43:11.892] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [16:43:11.919] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [16:43:11.946] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [16:43:11.976] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [16:43:12.010] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [16:43:12.044] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [16:43:12.088] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [16:43:12.202] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [16:43:12.318] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [16:43:12.412] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [16:43:12.442] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [16:43:12.486] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [16:43:12.529] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [16:43:12.587] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [16:43:12.645] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [16:43:12.688] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [16:43:12.875] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [16:43:13.064] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [16:43:13.236] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-oldrel-windows-x86_64
These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.