OlliteRT

On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control.

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon.

The most advanced, fully offline client-side AI suite on Android today.