A high-throughput and memory-efficient inference and serving engine for LLMs
vLLM Tops GitHub Trending
vLLM, a high-throughput and memory-efficient inference and serving engine for LLMs maintained by vllm-project, is trending on GitHub.
vLLM, a high-throughput and memory-efficient inference and serving engine for LLMs maintained by vllm-project, is trending on GitHub.
A high-throughput and memory-efficient inference and serving engine for LLMs