The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.

TRexSelector R package guide

T-Rex+SPCA: sparse principal components under FDR control

Sparse loadings with a guarantee

Principal component analysis (PCA) finds the directions of largest variance, and every variable contributes to every loading vector. Sparse PCA asks for loadings with few non-zero entries, so that a component can be read as a small set of variables. The T-Rex sparse PCA (T-Rex+SPCA) [1] decides which variables enter a loading vector with the T-Rex selector. For each of the \(M\) components, ordinary PCA gives the component as a response, a T-Rex+GVS run with the elastic net selects the variables for it at the target false discovery rate (FDR), and a sparse loading vector is assembled from the selected set. The selected set of every component is FDR-controlled.

Data with two sparse factors

Two latent factors, the first loading on variables 1 to 10 and the second on variables 31 to 40, plus noise.

set.seed(77)
n <- 200
p <- 60
Z <- matrix(rnorm(n * 2), n, 2)
V <- matrix(0, p, 2)
V[1:10, 1] <- 1 / sqrt(10)
V[31:40, 2] <- 1 / sqrt(10)
X <- 6 * Z[, 1] %*% t(V[, 1]) + 3 * Z[, 2] %*% t(V[, 2]) + matrix(rnorm(n * p), n, p)

Running the selector

TRexSPCASelector$new(X, M, tFDR, control, seed, verbose) extracts M components. The elastic-net penalty of the inner selector is chosen by cross-validation by default. X is centered in place during select() and restored on return.

spca <- TRexSPCASelector$new(X, M = 2, tFDR = 0.1, seed = 9, verbose = FALSE,
                             control = trex_spca_control(K = 10))
spca$select()
spca$active_sets
#> [[1]]
#>  [1]  1  2  3  4  5  6  7  8  9 10
#> 
#> [[2]]
#>  [1] 31 32 33 34 35 36 37 38 39 40

The results are the scores Z (\(n \times M\)), the sparse loadings V (\(p \times M\)), the selected sets, and the explained variance.

dim(spca$Z)
#> [1] 200   2
dim(spca$V)
#> [1] 60  2
round(spca$adjusted_ev, 3)
#> [1] 38.578  9.919
round(spca$cumulative_ev, 3)
#> [1] 0.364 0.458
library(ggplot2)
loadings <- data.frame(variable = rep(seq_len(p), 2), loading = c(spca$V[, 1], spca$V[, 2]),
                       component = rep(c("loading 1", "loading 2"), each = p))
on_support <- (loadings$component == "loading 1" & loadings$variable %in% 1:10) |
  (loadings$component == "loading 2" & loadings$variable %in% 31:40)
loadings$kind <- ifelse(on_support, "true support", "other")
ggplot(loadings, aes(variable, loading, colour = kind)) +
  geom_hline(yintercept = 0, linewidth = 0.3, colour = "grey40") +
  geom_segment(aes(xend = variable, yend = 0), linewidth = 0.8) +
  facet_wrap(~ component) +
  scale_colour_manual(values = c("true support" = "#336C68", "other" = "#D1495B")) +
  labs(x = "Variable", y = NULL, colour = NULL) +
  theme_bw(base_size = 11) +
  theme(legend.position = "right",
        legend.background = element_rect(fill = "white", colour = "grey60"))
The two sparse loading vectors. The true supports are variables 1 to 10 and 31 to 40.

The two sparse loading vectors. The true supports are variables 1 to 10 and 31 to 40.

Sparse components are not orthogonal in general, so the explained variance is adjusted for the non-orthogonality by a QR decomposition of the scores. adjusted_ev is the adjusted variance of each component, and cumulative_ev is the cumulative adjusted variance as a fraction of the total variance of the centered X.

The control

trex_spca_control() sets the inner machinery.

T-Rex+SPCA is defined on the elastic net, and gvs_type = "IEN" is rejected.

thr <- TRexSPCASelector$new(X, M = 2, tFDR = 0.1, seed = 9, verbose = FALSE,
                            control = trex_spca_control(mode = "Thresholded", K = 10))
thr$select()
thr$active_sets
#> [[1]]
#>  [1]  1  2  3  4  5  6  7  8  9 10
#> 
#> [[2]]
#>  [1] 31 32 33 34 35 36 37 38 39 40
round(thr$cumulative_ev, 3)
#> [1] 0.365 0.459

Memory-mapped data

X may be a memory-mapped matrix opened in "readwrite" mode (see the memory-mapping page). It is centered in the file during select() and restored. The centering happens under every scaling mode, so a file opened in "readonly" mode is refused.

Examples

The TRexSelector_Examples repository holds runnable demos and Monte Carlo studies of T-Rex+SPCA, with their results and a README per demo, in R, Python and C++.

Bibliography

[1]
J. Machkour, A. Breloy, M. Muma, D. P. Palomar, and F. Pascal, “Sparse PCA with false discovery rate controlled variable selection,” in Proc. IEEE 49th int. Conf. Acoust., speech, signal process. (ICASSP), 2024, pp. 9716–9720. doi: 10.1109/ICASSP48485.2024.10448237.

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.