Skip to main content

​
Setup

If your LiteLLM deployment is hosted on a private or corporate network, make sure you’re connected to your company’s VPN before proceeding.
Make sure you are on the latest version of Firebender (1.0.3) for the best LiteLLM integration experience.
  1. Go to firebender.com/settings?tab=provider
  2. Ensure the org LiteLLM API key and base URL are configured. If not, ask your LiteLLM admin or whoever manages your LiteLLM deployment.
Organization LiteLLM settings
  1. Add your own LiteLLM virtual key provided by your admin.
Personal LiteLLM virtual key settings
  1. Open Models in Firebender Settings and click Model Sync.
Model Sync in Firebender Settings
  1. Firebender should now pull in your LiteLLM models, and you can select them from the model selector in chat.
LiteLLM model picker showing synced models