LocalAI

Short answer: How to self-host LocalAI: requirements, licence and alternatives.

Last updated: 15 October 2026 · No tax figures on this site, so no GOV.UK check applies; tool details come from each project's public GitHub repository · Markdown version

OpenAI-compatible API server for local models.

Category	LLM runtime
Licence	MIT
Repo	mudler/LocalAI

How do you self-host it?

See the official README for Docker or binary install. A 2 vCPU / 4 GB VPS runs most UIs; LLM runtimes need a GPU or must run small quantised models on CPU.

What are the alternatives?

Ollama, vLLM, llama.cpp