OpenAppsSubmit

Ggrun

by raketenkater

AI & LLMSelf-hosted

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

View on GitHubDownload
Ggrun on GitHub

Open-source alternative to

Ollama

Tags

#cuda#gguf#golang#inference-server#llama-cpp#llamacpp#llm#local-llm

Similar apps

More in this category
  • FoxAI & LLMalt. to Ollama

    A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port.

    189Rust
    7mo ago
  • Vllm MlxAI & LLM

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon.

    1.6kPythonApache-2.0macOSDesktop
    10mo ago
  • Strix Halo GuideAI & LLM

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    354PythonMIT
    7mo ago
  • Qwen38 UncensoredAI & LLM

    Local Qwen 3.8 27B uncensored Q4_K_M + harvested SYSTEM pack. Official 3.8 weights, not a 3.6 retitle.

    337JavaScript
    2mo ago
  • WhatcanirunAI & LLM

    Find the best models and how to run them locally.

    247TypeScriptMIT
    7mo ago
  • JanAI & LLMalt. to ChatGPT

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    45kRustDesktopSelf-hosted
    3.2y ago