Runtimes & apps Published:
llama.cpp v0.6.0 adds GLM-5.3-Flash, a decision-model API and faster Metal kernels
llama.cpp published v0.6.0 on October 5, one of its numbered releases alongside the daily builds. It adds support for Z.ai's 320B GLM-5.3-Flash and the Clef decision model, multi-token-prediction speculative decoding for Qwen4Exp models (about 1.5x faster decoding on DGX Spark), and a /v1/systemone server endpoint for decision models. On Apple GPUs it brings a new flash-attention kernel for F16 KV caches and matrix-multiplication kernels that are up to about 3x faster for speculative and batched decoding. The built-in web UI was also reworked around downloading models from Hugging Face.
Why it matters locally
Qwen3.8-Flash-Next (a Qwen4Exp model) and GLM-5.3-Flash can now run as GGUF files, and apps that bundle llama.cpp will pick these changes up as they update.
Source
Read the official source: llama.cpp v0.6.0 release notes (GitHub) ↗Summaries are written by OnPrem World from the official source. We link to the original and never republish it.
On this site
More news
- NVIDIA RTX Spark laptops with up to 128 GB of unified memory go on sale October 16
- AMD's next Ryzen AI Halo: Ryzen AI Max+ PRO 495 with up to 192 GB of unified memory
- Open WebUI 0.12 adds two-factor sign-in, shared chats you can reply in, and realtime voice
- Ollama 0.40.2 upgrades older model downloads in the background and keeps backups
- EmbeddingGemma 2: a 740M multimodal embedding model for local search and RAG