GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs| Documentation | Blog | Paper | Discord | Latest News 🔥 [2024/04] We hosted the third vLLM meetup with Roblox! Please find the meetup slides here. [2024/01] We hosted the second vLLM meetup in SF! Please find the meetup slides here. [2024/01] Added ROCm 6.0 support to vLLM. [2023/12] Added ROCm 5.7 support to vLLM. [2023/10] We hosted the first vLLM meetup in SF! Please find the meetup slides he
