The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.
Principal component analysis (PCA) finds the directions of largest variance, and every variable contributes to every loading vector. Sparse PCA asks for loadings with few non-zero entries, so that a component can be read as a small set of variables. The T-Rex sparse PCA (T-Rex+SPCA) [1] decides which variables enter a loading vector with the T-Rex selector. For each of the \(M\) components, ordinary PCA gives the component as a response, a T-Rex+GVS run with the elastic net selects the variables for it at the target false discovery rate (FDR), and a sparse loading vector is assembled from the selected set. The selected set of every component is FDR-controlled.
Two latent factors, the first loading on variables 1 to 10 and the second on variables 31 to 40, plus noise.
TRexSPCASelector$new(X, M, tFDR, control, seed, verbose)
extracts M components. The elastic-net penalty of the inner
selector is chosen by cross-validation by default. X is
centered in place during select() and restored on
return.
spca <- TRexSPCASelector$new(X, M = 2, tFDR = 0.1, seed = 9, verbose = FALSE,
control = trex_spca_control(K = 10))
spca$select()
spca$active_sets
#> [[1]]
#> [1] 1 2 3 4 5 6 7 8 9 10
#>
#> [[2]]
#> [1] 31 32 33 34 35 36 37 38 39 40The results are the scores Z (\(n \times M\)), the sparse loadings
V (\(p \times M\)), the
selected sets, and the explained variance.
dim(spca$Z)
#> [1] 200 2
dim(spca$V)
#> [1] 60 2
round(spca$adjusted_ev, 3)
#> [1] 38.578 9.919
round(spca$cumulative_ev, 3)
#> [1] 0.364 0.458library(ggplot2)
loadings <- data.frame(variable = rep(seq_len(p), 2), loading = c(spca$V[, 1], spca$V[, 2]),
component = rep(c("loading 1", "loading 2"), each = p))
on_support <- (loadings$component == "loading 1" & loadings$variable %in% 1:10) |
(loadings$component == "loading 2" & loadings$variable %in% 31:40)
loadings$kind <- ifelse(on_support, "true support", "other")
ggplot(loadings, aes(variable, loading, colour = kind)) +
geom_hline(yintercept = 0, linewidth = 0.3, colour = "grey40") +
geom_segment(aes(xend = variable, yend = 0), linewidth = 0.8) +
facet_wrap(~ component) +
scale_colour_manual(values = c("true support" = "#336C68", "other" = "#D1495B")) +
labs(x = "Variable", y = NULL, colour = NULL) +
theme_bw(base_size = 11) +
theme(legend.position = "right",
legend.background = element_rect(fill = "white", colour = "grey60"))The two sparse loading vectors. The true supports are variables 1 to 10 and 31 to 40.
Sparse components are not orthogonal in general, so the explained
variance is adjusted for the non-orthogonality by a QR decomposition of
the scores. adjusted_ev is the adjusted variance of each
component, and cumulative_ev is the cumulative adjusted
variance as a fraction of the total variance of the centered
X.
trex_spca_control() sets the inner machinery.
mode: "ActiveSet" (default) assembles the
loading by a ridge regression of the component on the selected variables
with penalty lambda2_ridge_loadings,
"Thresholded" keeps the top \(|A|\) ordinary loadings and normalizes
them.lambda_2 and lambda2_method: the
elastic-net penalty of the inner group selector, fixed or chosen by
ridge cross-validation ("CV_1SE_CCD" by default when
lambda_2 < 0). A value of 0 is the degenerate lasso case
and gives a warning.en_solver: "TENET_AUG" (default) or
"TENET", two forms of the same elastic net.K and max_dummy_multiplier: the random
experiments and the dummy cap of the inner selector.T-Rex+SPCA is defined on the elastic net, and
gvs_type = "IEN" is rejected.
X may be a memory-mapped matrix opened in
"readwrite" mode (see the memory-mapping page). It is
centered in the file during select() and restored. The
centering happens under every scaling mode, so a file opened in
"readonly" mode is refused.
The TRexSelector_Examples repository holds runnable demos and Monte Carlo studies of T-Rex+SPCA, with their results and a README per demo, in R, Python and C++.
These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.