# Guides

> OnPrem World · https://onpremworld.com/en/guides · Updated: 2026-10-14 · CC BY 4.0

Step-by-step guides for running AI on your own hardware. Each one answers the question first, then shows the steps, with commands checked against the official docs and numbers taken from our hardware and model data.

## [How to run an LLM on your own computer with Ollama (Windows, macOS, Linux)](https://onpremworld.com/en/guides/install-ollama.md)

Install Ollama, pick a model that fits your memory, and run it with one command. Verified install steps for Windows, macOS and Linux, plus context length, GPU checks, the local API and local-only mode.

Updated: 2026-10-14

## [Choosing a GPU for local LLMs: VRAM vs memory bandwidth](https://onpremworld.com/en/guides/choosing-a-gpu.md)

VRAM decides which models fit; memory bandwidth decides how fast they answer. What 12, 16, 24 and 32 GB cards can run, with estimates from our hardware and model data.

Updated: 2026-10-14

## [Running LLMs on a Mac: unified memory, how much RAM to buy, MLX vs llama.cpp](https://onpremworld.com/en/guides/mac-local-llm.md)

Any Apple Silicon Mac can run local LLMs because the GPU shares the Mac's memory. How much of it the GPU can use, which models fit in 16 to 512 GB, why bandwidth decides speed, and when to use MLX or llama.cpp.

Updated: 2026-10-14

## [Quantization explained: Q4_K_M vs Q8_0 vs FP16, and the memory and quality trade-offs](https://onpremworld.com/en/guides/quantization-explained.md)

What the quantization names mean, how much memory each level saves, and how much quality it costs, with published measurements from llama.cpp and Qwen and memory figures from our model data.

Updated: 2026-10-14

## [Ollama vs LM Studio vs llama.cpp vs vLLM: which runtime for which job](https://onpremworld.com/en/guides/ollama-vs-lm-studio-vs-llama-cpp-vs-vllm.md)

Four ways to run open models locally, compared on platforms, model formats, APIs, licences and multi-user serving, with verified install and start commands for each as of October 2026.

Updated: 2026-10-14

## [A private ChatGPT for your office: Open WebUI + Ollama on your own hardware](https://onpremworld.com/en/guides/private-chatgpt-open-webui.md)

Run a ChatGPT-style assistant for your team on a server you own: hardware sizing from our data, verified Docker setup for Open WebUI and Ollama, user accounts, document Q&A, a checklist for keeping data in-house, and the licences involved.

Updated: 2026-10-14