The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.

sacRebleu

The goal of sacRebleu is to provide a simple interface to the BLEU score, a metric for evaluating the quality of generated text. This package is inspired by the NLTK and sacrebleu implementations of the BLEU score, and is implemented in C++ for the R programming language.

Installation

You can install the development version of sacRebleu from GitHub with:

Linux and MacOS

# install.packages("devtools")
devtools::install_github("LazerLambda/sacRebleu")

Windows

This package builds upon the tok package, which requires the Rust toolchain to be installed. To install the rustup, follow the instructions at https://www.rust-lang.org/tools/install and at tok. After installing the Rust toolchain, you can install the development version of sacRebleu as described above.

Example

library(sacRebleu)
cand_corpus <- list("This is good", "This is not good")
ref_corpus <- list(list("Perfect outcome!", "Excellent!"), list("Not sufficient.", "Horrible."))
bleu_corpus <- bleu_corpus(ref_corpus, cand_corpus)

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.