OpenAppsSubmit

FreeToken

by FlashML-org

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

FreeToken on GitHub

Tags

  • Infrastructure for continually self‑improving agents

    7.5kPythonApache-2.0
    1mo ago
  • Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

    6.9kPythonApache-2.0
    21d ago
  • On-device Speech AI for Apple Silicon

    6.4kSwiftMITmacOSDesktopiOS
    2.7y ago
  • TypeDB: Built for systems, not records

    4.5kRustMPL-2.0
    10.3y ago
  • Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python.

    1.8kZigmacOSDesktop
    8mo ago
  • macOS menubar app for fast local DeepSeek V4.1, with 1M context.

    916SwiftMITmacOSDesktop
    4mo ago