GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs
| Documentation | Blog | Paper | Discord | Twitter/X | Developer Slack | Latest News 🔥 [2024/12] vLLM joins pytorch ecosystem! Easy, Fast, and Cheap LLM Serving for Everyone! [2024/11] We hosted the seventh vLLM meetup with Snowflake! Please find the meetup slides from vLLM team here, and Snowflake team here. [2024/10] We have just created a developer slack (slack.vllm.ai) focusing on coordinatin
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
[Bug]: gpt-oss -> FA3 not detected on RTX 5090 (Blackwell) – Sinks are only supported in FlashAttention 3 · Issue #22279 · vllm-project/vllm
