LLM API Clients

What are API Clients?

Montag access LLMs through their APIs, and currently provides three clients: OpenAI, Anthropic and Oobagooba (text-generation-web-ui), the last one is for locally-hosted LLMs.

The LLM API Client is the credentials to access an LLM Vendor API, and is used in conjunction with an LLM Configuration to provide access to the LLM to various services.

If you are using the quickstart, and have set the OPEN_API_KEY environment variable, then this will already be configured and ready to use for you.