Self-host Ollama: Mistral 7B with Levelrail

Mistral's 7B instruct model, served locally through Ollama's HTTP API.

  • Authorollama
  • LicenceMIT
  • Memory6 GiB
  • Archarm64
  • Services1

How to self-host Ollama: Mistral 7B

  1. Pull the images

    One image is pulled on your server.

    Show images
    • ollama/ollama:0.33.3
  2. Create the app

    One service starts in a single Compose app, with 1 named volume mount for your data, on port 11434.

  3. Fill in the secrets

    You do not have to fill in anything.

  4. Open it

    Without a domain the app gets an sslip.io address; add --domain SERVICE=HOST to use your own.

Ollama: Mistral 7B requirements

Memory
About 6 GiB
Architectures
amd64 image published, arm64 image published
Ports
11434
Domain
Optional, an sslip.io address is used without one
Settings
none to fill in
License
MIT, permissive license
  • Listed. It is in the catalog but not verified. Back up the data volume before changing an image tag.
  • Host ports. It publishes port 11434 on the host, so open them in the VPS firewall only if you want that.

Install Levelrail first

On a server with Levelrail running, run the command above, or open the dashboard: Apps, New app, Browse templates, then Ollama: Mistral 7B. New to Levelrail? Install it on a fresh VPS first.

docker pull ghcr.io/glincker/levelrail:latest

Then levelrail-cli login --device. See Getting started and the Ollama: Mistral 7B docs page.

Deploy Ollama: Mistral 7B your way

Every format below deploys the same pinned images. Pick the one that fits how you work.

Deploy Ollama: Mistral 7B from the CLI

levelrail-cli templates deploy ollama-mistral --name my-ollama-mistral

Deploy Ollama: Mistral 7B with the API

Create a token in the dashboard first. This one-click route deploys it as a trial app you can keep or remove.

curl -X POST -H "Authorization: Bearer $TOKEN" \
  https://levelrail.example.com/api/v1/service-templates/ollama-mistral/deploy

Ollama: Mistral 7B configuration

Ollama: Mistral 7B services

ServiceImagePortsVolumes
ollama ollama/ollama:0.33.3 11434 ollama_data -> /root/.ollama

Ollama: Mistral 7B environment variables

The catalog lists no environment variables for this template.

Ports and volumes

Ports
11434
Volumes
1 named mount: ollama_data -> /root/.ollama

Ollama: Mistral 7B FAQ

How much memory does Ollama: Mistral 7B need?

The catalog lists about 6 GiB of memory for Ollama: Mistral 7B.

Does Ollama: Mistral 7B run on arm64?

For Ollama: Mistral 7B, an arm64 image is published; amd64 is image published.

What licence is Ollama: Mistral 7B under?

Ollama: Mistral 7B is licensed under MIT, which is permissive, with few conditions on reuse.

Does Ollama: Mistral 7B need configuration before it starts?

No. The template fills in its own defaults.

Which ports does Ollama: Mistral 7B use?

Ollama: Mistral 7B listens on port 11434 inside the stack.

Where does Ollama: Mistral 7B keep its data?

In a named volume: ollama_data mounted at /root/.ollama.

Can I deploy Ollama: Mistral 7B on Dokploy or Dokku?

The services and pinned images on this page can be run on any Docker host. The public Dokploy templates list we compared does not have an entry with the same id for Ollama: Mistral 7B, so on Dokploy you would use a Docker Compose application with the file from this page. Dokku deploys container images with its own commands, so the pinned image ollama/ollama:0.33.3 is what you deploy there.

levelrail-cli templates deploy ollama-mistral --name my-ollama-mistral