OpenAppsSubmit

Self Hosted AI Stack

by hwdsl2

AI & LLMLinuxDesktopSelf-hosted

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools.

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

Visit websiteView on GitHubDownload
Self Hosted AI Stack on GitHub

Tags

#ai#ai-stack#cuda#docker#docker-compose#docling#embeddings#linux

Similar apps

More in this category
  • SwarmpitAI & LLM

    Lightweight AI-friendly Docker Swarm management

    3.5kClojureEPL-1.0Self-hostedWeb
    9.7y ago
  • WeKnoraAI & LLM

    Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

    33kGo
    1.2y ago
  • Nginx UIAI & LLM

    Yet another WebUI for Nginx

    12kGoAGPL-3.0WindowsmacOSLinux
    5.6y ago
  • OpenwhisprAI & LLM

    Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

    9.2kJavaScriptMITWindowsmacOSLinux
    1.3y ago
  • MicrosandboxAI & LLM

    easy, fast, programmable and local-first microVM runtime and library

    8.6kRustApache-2.0WindowsmacOSLinux
    2y ago
  • ReadAnyAI & LLM

    AI-powered cross-platform e-book reader with semantic search, RAG chat, local vector store, notes, TTS, and WebDAV sync.

    2.7kTypeScriptDesktopAndroid
    8mo ago