Skip to content

Add Off Grid (production-grade on-device LLM app) - #2

Open
Ganeshship wants to merge 1 commit into
AI-in-Transportation-Lab:mainfrom
Ganeshship:add-off-grid
Open

Add Off Grid (production-grade on-device LLM app)#2
Ganeshship wants to merge 1 commit into
AI-in-Transportation-Lab:mainfrom
Ganeshship:add-off-grid

Conversation

@Ganeshship

Copy link
Copy Markdown

Adds Off Grid to the Library section.

Off Grid is a production-deployed example of TinyML / on-device LLM inference at consumer scale — sits naturally alongside Edge Impulse and the Legend of Elya entry as a real-world demonstration of resource-constrained ML.

  • Open-source iOS / Android consumer app, MIT-licensed
  • Runs Llama 3.2, Qwen 3, Gemma 3, Phi-4, DeepSeek R1 entirely on-device via llama.cpp + GGUF
  • 15-30 tok/s on flagship phones, 5-15 tok/s on mid-range
  • Includes whisper.cpp (speech-to-text), vision (SmolVLM, Qwen-VL), Stable Diffusion image gen with NPU acceleration on Snapdragon
  • 10K+ Android installs, 4.3★ App Store

Happy to drop into a different subsection if you'd prefer a dedicated "Mobile / Production Apps" grouping.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant