The hardware and bandwidth for this mirror is donated by dogado GmbH, the Webhosting and Full Service-Cloud Provider. Check out our Wordpress Tutorial.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]dogado.de.

Getting Started with chatcache

library(chatcache)

Introduction

chatcache provides a persistent cache for LLM interactions when using the ellmer and shinychat packages. It stores user prompts and model responses in a local SQLite database so repeated queries do not hit the API again.

Basic usage

library(ellmer)
library(chatcache)

# Initialize (optional — happens automatically)
chatcache_init()

chat <- chat_openai(system_prompt = "Be concise.")

# First call goes to the API and is cached
answer <- cached_chat(chat, "What is the capital of France?")

# Second call returns instantly from cache
answer <- cached_chat(chat, "What is the capital of France?")

# See what is cached
chatcache_list()

Using with shinychat

library(shiny)
library(shinychat)
library(ellmer)
library(chatcache)

ui <- bslib::page_fluid(
  chat_ui("chat")
)

server <- function(input, output, session) {
  chat <- chat_openai(system_prompt = "You are a helpful assistant.")

  observeEvent(input$chat_user_input, {
    cached_shinychat_respond(chat, input$chat_user_input, "chat")
  })
}

shinyApp(ui, server)

Cache management

# List recent entries
chatcache_list(limit = 20)

# Clear everything (interactive confirmation)
chatcache_clear()

# Or force clear
chatcache_clear(confirm = FALSE)

Cache location

By default the database lives in the user cache directory:

tools::R_user_dir("chatcache", which = "cache")

You can override it:

chatcache_init(cache_dir = "path/to/my/cache")

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.
Health stats visible at Monitor.