How much RAM do I need to run a local LLM on a Mac?
At 4-bit quantization and moderate context, plan 16GB of unified memory for 7B–8B models, 24–32GB for 12B–32B, 64GB for 70B and 96–128GB for 70B at higher precision or 100B+ models. Longer context and parallel sessions add KV cache on top.
Is 16GB of unified memory enough for Ollama or LM Studio?
Yes for 7B–8B models at Q4/Q5 with short to moderate context. 12B–14B models start but leave little room for a browser and IDE, so 24GB is the more comfortable entry point.
Can a Mac run a 70B model?
Yes. A 70B Q4_K_M file is about 43GB according to llama.cpp, so 64GB is the first practical tier with short context. 96GB or 128GB leaves room for longer context, higher-bit quantization and other apps.
Does unified memory work like VRAM?
Partly. On Apple silicon the CPU and GPU share one memory pool, so the GPU can address far more memory than a typical consumer graphics card. The same pool is also used by macOS and every open app, which is why the calculator keeps a reserve. One limit remains: by default macOS lets the GPU keep only part of that pool resident (Metal’s recommendedMaxWorkingSetSize, measured at roughly two thirds on smaller and three quarters on larger Macs; llama.cpp logs the exact value). The calculator warns when weights, KV cache and buffers exceed that share of your Mac’s memory.
Which new local models fit which Mac (October 2026)?
At Q4 with Ollama: 16GB runs Qwen 3.5 9B and Gemma 4 12B. 24GB runs gpt-oss 20B, and Qwen 3.8 27B (August 2026) or Meta Muse Glimmer 30B (August 2026) only at short context; 32–36GB gives those two 32K context. gpt-oss 120B needs 96GB or more. Model list checked on Hugging Face and the Ollama library on 4 October 2026.
Do MoE models like Gemma 4 26B A4B or Qwen 3.6 35B A3B need less RAM?
No. Only 3B–4B parameters are active per token, which makes them fast, but every expert has to stay in memory. Plan RAM for the full 26B or 35B weights; their small KV cache is the real saving at long context.
Can an 8GB Mac run a local LLM?
Only small models. 1B–4B text models at Q4, such as Llama 3.2 3B or Qwen3 4B, run with short context, because macOS itself needs several gigabytes. Multimodal models like Gemma 4 E4B already ship as files of about 10GB in Ollama. For regular local AI, 16GB is the practical minimum.
Does MLX use less memory than Ollama or LM Studio?
Not fundamentally. All of them load quantized weights, a KV cache and some runtime buffers into the same unified memory. Differences come from the quantization format and default context, so compare at the same bit width and context length.
How accurate is this calculator?
It is an estimate, not a benchmark. It adds model weights, KV cache, runtime buffers, optional extra parts such as vision or an n-gram table and your app reserve, and targets at most 85% memory use. Runtime version, model format and prompt length change the real figure.