Peer-to-peer distributed AI inference using 1-bit quantized models. CPU-only, 70-82% energy savings, 103+ tokens/sec. Validated on Zen 4 & Zen 5 (+35% cross-gen improvement).
-
Updated
Jun 4, 2026 - Python
#
1-bit-llm
Here are 8 public repositories matching this topic...
Navigable Degeneracy in the Roots of 1-Bit Language Models
-
Updated
Apr 18, 2026 - Jupyter Notebook
Windows-native BitNet and ternary LLM inference with CPU GGUF, GPU runtime, terminal and browser chat, and release zips.
windows cuda pytorch quantization bitnet fastapi llama-cpp local-llm llm-inference gguf 1-bit-llm ternary-llm falcon3
-
Updated
Mar 20, 2026 - Python
Two-piece Rust runtime + preprocessor for running medium-sized (1-7B) public LLMs on CPU-only humble hardware (older x86, ARM, retro). Currently: BitNet b1.58 2B with NEON kernel.
rust raspberry-pi neon inference simd quantization aarch64 ternary low-resource retro-computing bitnet apple-silicon cpu-inference llm ggml gguf cpu-only 1-bit-llm
-
Updated
May 30, 2026 - Rust
Desktop chat app for Microsoft's 1-bit BitNet LLMs. Windows-native, CPU-only, zero dependencies
desktop-app windows chat-ui 1-bit pywebview bitnet openai-api cpu-inference llm openai-api-chatbot llama-cpp local-llm 1-bit-llm microsoft-bitnet
-
Updated
Apr 14, 2026 - Python
Run 8B-parameter 1-bit LLMs on NVIDIA Jetson Nano (CUDA 10.2, SM 5.3). Patched PrismML/llama.cpp fork for Q1_0_g128 Bonsai models.
inference nvidia tegra arm64 quantization bonsai jetson maxwell 1-bit embedded-ai cuda-10 edge-ai jetson-nano llm llama-cpp local-llm gguf 1-bit-llm q1-quantization cuda-compatibility
-
Updated
Apr 4, 2026 - C++
High-performance hybrid architecture for Agent Zero & BitNet b1.58. Natively optimized for Windows ARM64 (Snapdragon X Elite / Copilot+ PCs) using raw C++ inference and Docker-based agent orchestration.
-
Updated
Feb 6, 2026 - Python
First 1-bit (BitNet b1.58) recursive reasoner for Sudoku-Extreme - distilled from a 7M-param FP TRM teacher into a 1.4 MB ternary student
pytorch sudoku mps hrm knowledge-distillation trm bitnet edge-ai ternary-weights quantization-aware-training apple-silicon tiny-models reasoning-engine efficient-ml tiny-recursive-model recursive-reasoning 1-bit-llm bitnet-b158 bitdistill sudoku-extreme
-
Updated
May 8, 2026 - Python
Improve this page
Add a description, image, and links to the 1-bit-llm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the 1-bit-llm topic, visit your repo's landing page and select "manage topics."