# Best self-hosted LLM runtime tools | SelfHostAI

Source: https://ai.andreiturcea.com/cat-llm-runtime.html
Last updated: 2026-10-15


**Short answer:** Open-source LLM runtime tools you can self-host.

Last updated: 15 October 2026 · No tax figures on this site, so no GOV.UK check applies; tool details come from each project's public GitHub repository · [Markdown version](https://ai.andreiturcea.com/cat-llm-runtime.html.md)

**Ollama**: Run LLMs locally with a single command.

**LocalAI**: OpenAI-compatible API server for local models.

**vLLM**: High-throughput LLM serving engine.

**llama.cpp**: LLM inference in C/C++, runs on CPU.