About vLLM
OpenAI-compatible local inference runtime optimized for GPU-backed serving
Project details
License
Apache-2.0
Packaging
Helm chart
Min. Requirements
4 CPU, 16GB RAM, 50GB disk
Website
docs.vllm.ai
Source Code
vllm-project/vllm
Or have it managed.
If you would rather not operate vLLM by hand, Anchras Platform connects its deployment lifecycle, private networking, policy, logs, and audit on infrastructure you control. The platform is in closed beta; the catalog stays free here either way.
