Runtimes & apps Published:
Ollama 0.32.15 roughly halves time to first token by caching model metadata
Ollama v0.32.15 caches resolved model metadata between requests, which cut time to first token from about 995 ms to about 524 ms in Ollama's benchmarks. It also fixes a bug where chat and generate requests could hang after a parser error mid-stream, and handles Qwen 3.8 system messages that appear later in a conversation consistently. First-time desktop users get a new onboarding flow.
Why it matters locally
Coding agents and editor plugins that send many short requests feel this most, since half a second saved per call adds up over a long session.
Source
Read the official source: Ollama v0.32.15 release notes (GitHub) ↗Summaries are written by OnPrem World from the official source. We link to the original and never republish it.
More news
- NVIDIA RTX Spark laptops with up to 128 GB of unified memory go on sale October 16
- AMD's next Ryzen AI Halo: Ryzen AI Max+ PRO 495 with up to 192 GB of unified memory
- Open WebUI 0.12 adds two-factor sign-in, shared chats you can reply in, and realtime voice
- Ollama 0.40.2 upgrades older model downloads in the background and keeps backups
- EmbeddingGemma 2: a 740M multimodal embedding model for local search and RAG