Runtimes & apps Published:
llama.cpp reaches v1.0.0 with semantic versioning, FP8 KV caches and a MoE expert cache

What happened
llama.cpp and its ggml library both reached version 1.0.0 on November 13, and from now on a major version bump will signal any breaking change to their public C API. The release removes 35 deprecated functions, adds FP8 (E4M3) KV caches, and adds a host-memory cache for MoE experts with a configurable share of work left on the CPU. It supports three new text architectures, Kimi-K3.1-Pro, Ripple and xing4_0, plus drama-3 text-to-speech and Kimi-K3.1 and MageVL-Cowork vision. `llama-server` gets security fixes for CORS, DNS rebinding and SSRF, an OpenAI-compatible `/v1/audio/speech` endpoint and a redesigned web UI with chat groups.
Why it matters locally: The engine underneath many local AI apps now promises stable versioning, and its FP8 KV cache and MoE expert cache aim to fit longer contexts and larger MoE models into the memory you already have.
Three ways to read it
For the market
A 1.0 label with a semantic-versioning promise makes llama.cpp easier to justify inside companies that need predictable upgrades, which likely helps the apps built on it more than llama.cpp itself. The v1.0 announcement credits hardware support from NVIDIA, AMD, Qualcomm, Arm, IBM and Intel, a sign that chip vendors now treat it as a target worth backing.
In plain words
llama.cpp is the free engine many "run AI on your own computer" apps use under the hood. Version 1.0 is its official grown-up release: fewer surprise breakages, and it can squeeze bigger models into the same computer.
For practitioners
Try `-ctk f8_e4m3 -ctv f8_e4m3` to cut KV cache memory for long contexts, and the new `moe_cache_size` / `moe_cache_cpu_share` context parameters when MoE experts don't fit in GPU memory; measure quality and speed on your own prompts first. Code linking `libllama` directly must migrate: 35 deprecated functions, `llama_set_warmup` and `--defrag-thold` are gone, and `clip.h` is folded into `mtmd`. If you expose `llama-server` on a network, note the new `--allow-unauthenticated-tools` and `--media-allow-private-urls` opt-ins.
Sprout's insight
Sprout compares this with other brands and with where real applications are heading. Free for members.
Sign in free to read it →Subscribe to Sprout's weekly
One email a week: the top stories and a taste of Sprout’s insights. Unsubscribe any time.
Source
Read the official source: llama.cpp v1.0.0 release notes (GitHub) ↗Summaries are written by OnPrem World from the official source. We link to the original and never republish it.
More news
- NVIDIA and Microsoft bring Nemotron 3.5 and RTX PRO 6000 Blackwell support to Azure Local
- Microsoft publishes Aion 1.0 Instruct, the 2.3B model that becomes Windows' built-in AI by end of January 2027
- RTX Spark compact desktops from ASUS, Dell and MSI go on sale with up to 128 GB of unified memory
- NVIDIA reports $115.8 billion quarter; highlights include a deal to acquire Hugging Face and a 64GB DGX Spark
- Open WebUI v0.13.4 moves personal connections into Tether, sandboxes agents on your own computer and runs local MCP servers