Documentation
README
Butterbase AI Gateway
Every app has an LLM gateway with chat, embeddings, model listing, configuration, and usage reporting. One umbrella tool: manage_ai.
| Action | What it does | Returns |
|---|---|---|
chat |
Synchronous chat completion (no streaming) | OpenAI-shaped { choices: [...] } |
embed |
Vector embeddings for string or string[] | OpenAI-shaped { data: [{ embedding: [...] }] } |
list_models |
Available models with capabilities | { models: AiModel[] } |
get_config |
Current AI config (default model, BYOK key flag, etc.) | AiConfig |
update_config |
Set defaults, allowed models, max tokens, BYOK | AiConfig |
get_usage |
Token + cost aggregate over a window | usage record |
1. Chat
This is the opening of the README. Read the full README on GitHub.