Skip to content

Choosing a model

Olyvr does not include its own AI model. It connects to one you choose, in Settings → Model access.

Option Best for What you need
ChatGPT or Claude subscription Most people: use the plan you already pay for A ChatGPT or Claude account
Custom endpoint API keys, company gateways, self-hosted servers A base URL and usually an API key
Local models (preview) Trying open-weight models on your own hardware 16–32 GB of RAM and disk space for the model

A model is used for:

  • the chat agent: answers, drafts and edits
  • generating memory notes and preferences
  • extracting tasks for My Day, and writing work plans

Everything else works without one: importing, searching, browsing documents, managing sources, editing notes by hand, and exporting.

The agent streams responses and calls tools, so the model and endpoint must support streaming chat completions with tool calling (the OpenAI chat/completions API with tools). Most current hosted models do. Smaller local models may struggle with multi-step tool use.