Open-source alternatives
3 open-source alternatives to Ollama
Free apps you can download, self-host or modify instead of paying for Ollama. Ranked by GitHub stars.
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool…
4kPythonmacOSDesktopllama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
281GoMITSelf-hostedA local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port.
189Rust
