Automation
Self-host Ollama on a VPS
Run large language models locally.
Download and run open LLMs behind a simple API, entirely on your own hardware.
Why self-host Ollama?
Ollama lets you run private AI models with no data leaving your server and no per-token costs.
How to install Ollama
- 1
Provision a VPS
Choose a plan with room for your data as well as the app.
- 2
Install the stack
Install Go runtime + model weights.
- 3
Deploy the application
Follow the project’s official install guide for your distribution.
- 4
Enable HTTPS
Serve it on your own domain behind a reverse proxy with a certificate.
- 5
Back it up
Schedule a database dump plus a copy of any uploaded files to an off-box location.
Practical tips
- Give Ollama its own database user with rights only on its own schema.
- Reverse-proxy Ollama and terminate TLS at the proxy so certificates are managed in one place.
- Take a VPS snapshot before major upgrades so you can roll back cleanly.
- Keep Ollama patched — most self-hosting incidents are unpatched software.
Frequently asked questions
- How much RAM does Ollama need?
- Plan on 16 GB+ for typical use; add headroom if you expect many concurrent users.
- What stack does Ollama run on?
- Go runtime + model weights.
- Can I run other things on the same VPS?
- Yes — size the plan so Ollama plus your other workloads fit in RAM with room to spare.
Looking for something else? Popular alternatives include llama.cpp, vLLM, LocalAI — browse all app guides.