Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
-
Updated
Dec 20, 2025 - Python
#
optimum-intel
Here are 4 public repositories matching this topic...
Most simple and minimal code to run an LLM chatbot from HuggingFace hub with OpenVINO
python chatbot intel transformers text-generation llama openvino huggingface huggingface-transformers large-language-models llm tinyllama neuralchat optimum-intel llm-post-process
-
Updated
Feb 19, 2024 - Python
Optimized Climate Sentiment Classification Pipeline
-
Updated
May 24, 2025 - Python
Jupyter Notebook for LLM compression via quantization (INT8, INT4, FP16) and evaluation using metrics such as ROUGE and BLEU. Facilitates efficient LLM optimization.
-
Updated
Apr 18, 2025 - Jupyter Notebook
Improve this page
Add a description, image, and links to the optimum-intel topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the optimum-intel topic, visit your repo's landing page and select "manage topics."