vLLM
Short answer: How to self-host vLLM: requirements, licence and alternatives.
Last updated: · No tax figures on this site, so no GOV.UK check applies; tool details come from each project's public GitHub repository · Markdown version
High-throughput LLM serving engine.
| Category | LLM runtime |
| Licence | Apache-2.0 |
| Repo | vllm-project/vllm |
How do you self-host it?
See the official README for Docker or binary install. A 2 vCPU / 4 GB VPS runs most UIs; LLM runtimes need a GPU or must run small quantised models on CPU.
What are the alternatives?
Ollama, LocalAI, llama.cpp