Runtimes & apps Published:
Ollama 0.35 adds decision models that answer with probabilities instead of text
Ollama v0.35.0 added a /v1/systemone endpoint for decision models, based on TypeSafe's Jev API. Instead of writing prose, these models pick one of several options, give the probability that a condition is true, or score input against a rubric, returning probabilities with each answer. The first two are Nimble from Bespoke Labs and Tev1 from Together AI, aimed at jobs such as ticket triage, model routing and content classification.
Why it matters locally
Classification and routing tasks that used to need a chat model plus brittle output parsing can run on a small local model that returns a structured label and its probabilities.
Source
Read the official source: Ollama v0.35.0 release notes (GitHub) ↗Summaries are written by OnPrem World from the official source. We link to the original and never republish it.
More news
- NVIDIA RTX Spark laptops with up to 128 GB of unified memory go on sale October 16
- AMD's next Ryzen AI Halo: Ryzen AI Max+ PRO 495 with up to 192 GB of unified memory
- Open WebUI 0.12 adds two-factor sign-in, shared chats you can reply in, and realtime voice
- Ollama 0.40.2 upgrades older model downloads in the background and keeps backups
- EmbeddingGemma 2: a 740M multimodal embedding model for local search and RAG