Ollama
Ollama runs LLMs locally on your VPS. Pull and serve Llama 3, Mistral, Phi, Gemma, and Qwen with one command. Self-hosted AI without an API key, REST API compatible with OpenAI clients. The simplest path to private inference, used by 200,000+ developers.
At a glance
License MIT Version Latest OS Ubuntu Server 24.04 LTS Min RAM 8 GB IP IPV4,IPV6
Active installs is sample data (staging preview); real metric wires in before launch.