How do I use Voxtral Mini 3B 2507 in SillyTavern?
mistralai/voxtral-mini-3b-2507In SillyTavern, open API Connections, set API to Chat Completion and Chat Completion Source to Custom (OpenAI-compatible), enter https://api.martllm.com/v1 in Custom Endpoint (Base URL), paste your MartLLM key into Custom API Key, click Connect, then type mistralai/voxtral-mini-3b-2507 in Enter a Model ID.
- API
Chat Completion- Chat Completion Source
Custom (OpenAI-compatible)- Custom Endpoint (Base URL)
https://api.martllm.com/v1- Custom API Key
ull_your_key- Enter a Model ID
mistralai/voxtral-mini-3b-2507
SillyTavern calls: OpenAI chat completions https://api.martllm.com/v1/chat/completions · Full SillyTavern guide
Replace ull_your_key with your MartLLM API key. One key works in every tool and for every model.
By API, Voxtral Mini 3B 2507 answers on three addresses with the same MartLLM key and the model id mistralai/voxtral-mini-3b-2507: OpenAI chat completions at https://api.martllm.com/v1/chat/completions, the OpenAI Responses API at https://api.martllm.com/v1/responses and the Anthropic Messages API at https://api.martllm.com/v1/messages.