The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.

sparklyr: R Interface to Apache Spark

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Version: 1.8.6
Depends: R (≥ 3.2)
Imports: config (≥ 0.2), DBI (≥ 1.0.0), dbplyr (≥ 2.5.0), dplyr (≥ 1.0.9), generics, globals, glue, httr (≥ 1.2.1), jsonlite (≥ 1.4), methods, openssl (≥ 0.8), purrr, rlang (≥ 0.1.4), rstudioapi (≥ 0.10), tidyr (≥ 1.2.0), tidyselect, uuid, vctrs, withr, xml2
Suggests: arrow (≥ 0.17.0), broom, diffobj, foreach, ggplot2, iterators, janeaustenr, Lahman, mlbench, nnet, nycflights13, R6, r2d3, RCurl, reshape2, shiny (≥ 1.0.1), parsnip, testthat, rprojroot
Published: 2024-04-29
DOI: 10.32614/CRAN.package.sparklyr
Author: Javier Luraschi [aut], Kevin Kuo ORCID iD [aut], Kevin Ushey [aut], JJ Allaire [aut], Samuel Macedo [ctb], Hossein Falaki [aut], Lu Wang [aut], Andy Zhang [aut], Yitao Li ORCID iD [aut], Jozef Hajnala [ctb], Maciej Szymkiewicz ORCID iD [ctb], Wil Davis [ctb], Edgar Ruiz [aut, cre], RStudio [cph], The Apache Software Foundation [aut, cph]
Maintainer: Edgar Ruiz <edgar at rstudio.com>
BugReports: https://github.com/sparklyr/sparklyr/issues
License: Apache License 2.0 | file LICENSE
URL: https://spark.posit.co/
NeedsCompilation: no
SystemRequirements: Spark: 2.x, or 3.x
Materials: README NEWS
In views: Databases, ModelDeployment
CRAN checks: sparklyr results

Documentation:

Reference manual: sparklyr.pdf

Downloads:

Package source: sparklyr_1.8.6.tar.gz
Windows binaries: r-devel: sparklyr_1.8.6.zip, r-release: sparklyr_1.8.6.zip, r-oldrel: sparklyr_1.8.6.zip
macOS binaries: r-release (arm64): sparklyr_1.8.6.tgz, r-oldrel (arm64): sparklyr_1.8.6.tgz, r-release (x86_64): sparklyr_1.8.6.tgz, r-oldrel (x86_64): sparklyr_1.8.6.tgz
Old sources: sparklyr archive

Reverse dependencies:

Reverse depends: s3.resourcer
Reverse imports: apache.sedona, catalog, geospark, graphframes, MSstatsBig, pathling, pysparklyr, rollup, rsparkling, shinyML, spark.sas7bdat, sparkavro, sparkbq, sparkhail, sparklyr.flint, sparklyr.nested, sparktf, sparkwarc, sparkxgb, variantspark
Reverse suggests: butcher, corrr, finnts, mlflow, modeltime, orbital, parsnip, pointblank, resourcer
Reverse enhances: vip

Linking:

Please use the canonical form https://CRAN.R-project.org/package=sparklyr to link to this page.

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.