Back to AI intel
重点
vLLM v0.30.0 Release: Adds Support for DeepSeek-V4.1-Flash with MXFP8 KV Storage
AI intel briefing
Core summary
One sentence to understand this update
vLLM version 0.30.0 has been released, featuring 762 commits and adding support for new models like DeepSeek-V4.1-Flash, which utilizes MXFP8 for KV storage via FlashMLA V4.1 on SM100.
Impact & opportunity
What this could mean
Developers using vLLM can now leverage the DeepSeek-V4.1-Flash model for more efficient inference, potentially leading to performance improvements and cost savings for large language model deployments.
Source
View original