The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.
chatcache provides a persistent cache for LLM
interactions when using the ellmer and shinychat packages. It
stores user prompts and model responses in a local SQLite database so
repeated queries do not hit the API again.
library(ellmer)
library(chatcache)
# Initialize (optional — happens automatically)
chatcache_init()
chat <- chat_openai(system_prompt = "Be concise.")
# First call goes to the API and is cached
answer <- cached_chat(chat, "What is the capital of France?")
# Second call returns instantly from cache
answer <- cached_chat(chat, "What is the capital of France?")
# See what is cached
chatcache_list()library(shiny)
library(shinychat)
library(ellmer)
library(chatcache)
ui <- bslib::page_fluid(
chat_ui("chat")
)
server <- function(input, output, session) {
chat <- chat_openai(system_prompt = "You are a helpful assistant.")
observeEvent(input$chat_user_input, {
cached_shinychat_respond(chat, input$chat_user_input, "chat")
})
}
shinyApp(ui, server)By default the database lives in the user cache directory:
You can override it:
These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.