The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.

HuggingFace language models are downloaded in .cache

Transformers Models from HuggingFace When specifying and running a language model for the first time in textEmbed(), the python package transformers will automatically download it from HuggingFace. These models can be rather large (a few GB), so you might want to remove models that you have no use for anymore.

library(text)

# Check downloaded, available models.
textModels()

# Delete a specified model and model associated files.
textModelsRemove("name_of_model_to_be_removed")

Advanced By default the files necessary to run the model are downloaded to the .cache folder. To see the hidden .cache folder on a Mac go to /Users/USER_NAME/ in Finder and press: CMD + SHIFT + . This reveals the .cache folder and its enclosed folders and files. Go to: /Users/USER_NAME/.cache/torch/transformers/ to find those files that have been downloaded by transformers.
Note that these files are awkwardly named (e.g., c146cc96724f27295a0c3ada1fbb3632074adf87…); but you might want to remove the larger files and then just re-run the textEmbed() again to download the models you want to use again.

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.