Back to AI intel
重点
vLLM v0.30.0 Released with DeepSeek-V4.1-Flash and MXFP8 KV Storage
AI intel briefing
Core summary
One sentence to understand this update
vLLM v0.30.0 has been released, featuring support for new models like DeepSeek-V4.1-Flash and storing the entire KV in MXFP8 via FlashMLA V4.1.
Impact & opportunity
What this could mean
This update allows builders to use cutting-edge models more efficiently with vLLM, potentially reducing inference costs and improving performance.
Source
View original