Self-host Bifrost with Levelrail
Fast open source LLM gateway that routes requests to many providers behind one OpenAI compatible API, with a web UI for keys and routing rules.
- Authormaximhq
- LicenceApache-2.0
- Memory256 MiB
- Services1
How to self-host Bifrost
-
Pull the images
One image is pulled on your server.
Show images
maximhq/bifrost:v2.5.1
-
Create the app
One service starts in a single Compose app, with 1 named volume mount for your data, on port 8080.
-
Fill in the secrets
You do not have to fill in anything.
-
Open it
Without a domain the app gets an sslip.io address; add --domain SERVICE=HOST to use your own.
After the first start
- Open the address, add provider keys in the web UI, then point your OpenAI compatible clients at it. Keep it private or add a login in front.
Bifrost requirements
- Memory
- About 256 MiB
- Architectures
- amd64 unknown, arm64 unknown
- Ports
- 8080
- Domain
- Optional, an sslip.io address is used without one
- Settings
- none to fill in
- License
- Apache-2.0, permissive license
- Listed. It is in the catalog but not verified. Back up the data volume before changing an image tag.
Install Levelrail first
On a server with Levelrail running, run the command above, or open the dashboard: Apps, New app, Browse templates, then Bifrost. New to Levelrail? Install it on a fresh VPS first.
docker pull ghcr.io/glincker/levelrail:latest Then levelrail-cli login --device. See Getting started and the Bifrost docs page.
Deploy Bifrost your way
Every format below deploys the same pinned images. Pick the one that fits how you work.
Deploy Bifrost from the CLI
levelrail-cli templates deploy bifrost --name my-bifrost Deploy Bifrost with the API
curl -X POST -H "Authorization: Bearer $TOKEN" \
https://levelrail.example.com/api/v1/service-templates/bifrost/deploy Bifrost configuration
Bifrost services
| Service | Image | Ports | Volumes |
|---|---|---|---|
| bifrost | maximhq/bifrost:v2.5.1 | 8080 | data -> /app/data |
Bifrost environment variables
The catalog lists no environment variables for this template.
Ports and volumes
- Ports
- 8080
- Volumes
- 1 named mount: data -> /app/data
Bifrost FAQ
How much memory does Bifrost need?
The catalog lists about 256 MiB of memory for Bifrost.
Does Bifrost run on arm64?
For Bifrost, arm64 support is not confirmed; amd64 is unknown.
What licence is Bifrost under?
Bifrost is licensed under Apache-2.0, which is permissive, with few conditions on reuse.
Does Bifrost need configuration before it starts?
No. The template fills in its own defaults.
Which ports does Bifrost use?
Bifrost listens on port 8080 inside the stack.
Where does Bifrost keep its data?
In a named volume: data mounted at /app/data.
Can I deploy Bifrost on Dokploy or Dokku?
The services and pinned images on this page can be run on any Docker host. The public Dokploy templates list we compared does not have an entry with the same id for Bifrost, so on Dokploy you would use a Docker Compose application with the file from this page. Dokku deploys container images with its own commands, so the pinned image maximhq/bifrost:v2.5.1 is what you deploy there.