Models Published:
DeepSeek-V4.1-Flash: a 552B multimodal MoE with a quarter of the KV cache
DeepSeek released V4.1-Flash on September 10, with open weights on Hugging Face under the MIT licence. It is a 552B-parameter mixture-of-experts model that understands images natively and activates about 8B parameters per token while reading the prompt and 16B while generating. A new causal encoder-decoder layout and a second version of DeepSeek's compressed sparse attention cut the KV cache per token to about a quarter of V4-Flash's, with contexts of up to one million tokens.
Why it matters locally
Long contexts become cheap, but the 552B backbone alone exceeds 256 GB at 4 bits, so local use means a 512 GB Mac Studio or a multi-GPU server; vLLM added support in v0.30.0 on September 22.
Source
Read the official source: DeepSeek-V4.1-Flash model card (Hugging Face) ↗Summaries are written by OnPrem World from the official source. We link to the original and never republish it.
On this site
More news
- NVIDIA RTX Spark laptops with up to 128 GB of unified memory go on sale October 16
- AMD's next Ryzen AI Halo: Ryzen AI Max+ PRO 495 with up to 192 GB of unified memory
- Open WebUI 0.12 adds two-factor sign-in, shared chats you can reply in, and realtime voice
- Ollama 0.40.2 upgrades older model downloads in the background and keeps backups
- EmbeddingGemma 2: a 740M multimodal embedding model for local search and RAG