Constrained decoding engine and JSON Schema to GBNF compiler for local LLM gateways with sub-millisecond logit masking
json-schema regex prefix-trie pydantic fastapi constrained-decoding llama-cpp vllm gbnf llm-gateway structured-outputs logit-masking gbnf-grammar grammar-compiler
-
Updated
Oct 14, 2026 - Python