Skip to main content

Setup

  1. Go to firebender.com/settings?tab=provider
  2. Ensure the org LiteLLM API key and base URL are configured. If not, ask your LiteLLM admin or whoever manages your LiteLLM deployment.
Organization LiteLLM settings
  1. Add your own LiteLLM virtual key provided by your admin.
Personal LiteLLM virtual key settings
  1. Open Models in Firebender Settings and click Model Sync.
Model Sync in Firebender Settings
  1. Firebender should now pull in your LiteLLM models, and you can select them from the model selector in chat.
LiteLLM models in the model picker