vLLM + Qwen3.5-122B-A10B-NVFP4 on NVIDIA DGX Spark (GB10/SM121) — single-GPU NVFP4 W4A4 with MTP speculative decoding, self-contained Docker build
-
Updated
Mar 12, 2026 - Python
#
vllm-server
Here are 7 public repositories matching this topic...
MLOps — vLLM + LiteLLM + Portainer CE + Netdata. Case study song ngữ: kiến trúc, metrics, bài học vận hành. · Self-hosted LLM inference done the MLOps way, a bilingual case study
docker gpu selfhosted self-hosted portainer observability case-study netdata llm case-study-project vllm vllm-production-stack vllm-server
-
Updated
Aug 16, 2026 - HTML
Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets
-
Updated
Aug 26, 2026 - Shell
A simple UI and config generator to run vLLM with Docker, GPU settings, model config parsing, memory estimation, and OpenAI-compatible test clients.
python docker flask docker-compose cuda flask-application model-serving mlops huggingface llm vllm vllm-ui vllm-serve vllm-server vllm-serving
-
Updated
Apr 30, 2026 - Python
Multi-agent system for automated mobile QA testing using LLMs, ADB, and vision-grounded execution with Simular Agent S3
-
Updated
Dec 20, 2025 - Python
Run an AI vision model on Google Colab and use it from your local computer through a public API.
google-colab colab-notebook googlecolab openai-api cloudflare-tunnel vision-language-model ollama multimodal-ai vllm-server run-llm-on-colab free-gpu-ai colab-gpu-api
-
Updated
May 3, 2026 - Python
Serves cyankiwi/Qwen3.8-27B-AWQ-INT4 (dense 27B vision-language, reasoning, apache-2.0, ~21GB INT4 weights) via vLLM on a single A100-80GB. via Modal
-
Updated
Aug 15, 2026 - Python
Improve this page
Add a description, image, and links to the vllm-server topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vllm-server topic, visit your repo's landing page and select "manage topics."