Releases: MinsungMJ/Local-Inference-System
Releases · MinsungMJ/Local-Inference-System
Release list
LIS v0.1.1 — CI and Documentation Update
LIS v0.1.1 adds automated validation and clarifies the documented Qwen3 prompt boundary. Runtime and model-support scope remain intentionally conservative.
What changed
- Added GitHub Actions CI on Ubuntu 24.04
- CI validates the C build, C test suites, and Python LIS Inspect tests
- Added a CI status badge to the README
- Documented that the Qwen3 path currently receives raw tokenizer text
- Clarified that LIS does not apply model-specific chat templates or expose thinking-mode controls
- Clarified that reasoning-oriented models may produce extended explanatory output under the raw-prompt and greedy-decoding path
- Generalized local maintainer-note ignore patterns
Scope remains unchanged
- CPU-only local inference
- Greedy decoding only
- Documented Llama-family plain-RoPE subset
- Narrow Qwen3 Dense BF16 path
- No GPU execution, serving, distributed inference, continuous batching, sampling framework, or broad Qwen-family claim
See the tagged README, v1 Support Matrix, and Qwen3 Dense Scope.
License
Apache License 2.0
LIS v0.1.0 — Initial Public Release
LIS v0.1.0 is the first public release of the Local Inference System.
LIS is a CPU-only inference runtime for causal decoder-only models, designed around correctness, inspectability, reproducible artifacts, and transparent diagnostics.
What’s included
- CPU reference execution for the documented Llama-family plain-RoPE subset
- A narrow Qwen3 Dense BF16 merged-safetensors path
- Deterministic greedy decoding
- Hugging Face tokenizer JSON subset support
- Opt-in execution reports, traces, diagnostics, and performance breakdowns
- LIS Inspect for reviewing
run_reportJSON and optional perf stderr logs - Model-free
make buildandmake test
Known limitations
- Greedy decoding only
- No sampling framework, GPU execution, serving, distributed inference, or continuous batching
- No model-specific chat-template or Jinja execution
- No thinking-mode control
- The Qwen3 path is intentionally narrow and does not imply broad Qwen-family support
See the tagged README and v1 Support Matrix for details.
License
Apache License 2.0