How much RAM do I need to run a local LLM on a Mac?
At 4-bit quantization and moderate context, plan on 16GB of unified memory for 7B–8B models, 24–32GB for 12B–32B, 64GB for 70B, and 96–128GB for higher-precision 70B or 100B+ models. Longer context and parallel sessions add KV cache on top.
Is 16GB of unified memory enough for Ollama or LM Studio?
Yes, for 7B–8B models at Q4/Q5 with short to moderate context. 12B–14B models will load, but they leave little room for a browser and IDE. 24GB is a more comfortable starting point.
Can a Mac run a 70B model?
Yes. A 70B Q4_K_M file is about 43GB according to llama.cpp, so 64GB is the first practical tier with short context. 96GB or 128GB leaves room for longer context, higher-bit quantization, and other apps.
Does unified memory work like VRAM?
Partly. On Apple Silicon, the CPU and GPU share one memory pool, so the GPU can access far more memory than a typical consumer graphics card. macOS and every open app share that same pool, which is why the calculator holds back a reserve. One limit remains: by default, macOS lets the GPU keep only part of that pool resident (Metal’s recommendedMaxWorkingSetSize, measured at roughly two-thirds on smaller Macs and three-quarters on larger ones; llama.cpp logs the exact value). The calculator warns you when weights, KV cache, and buffers exceed that share of your Mac’s memory.
Which new local models fit which Mac (October 2026)?
At Q4 with Ollama: 16GB runs Qwen 3.5 9B and Gemma 4 12B. 24GB runs gpt-oss 20B, and runs Qwen 3.8 27B (August 2026) or Meta Muse Glimmer 30B (August 2026) only at short context. With 32–36GB, both get 32K context. gpt-oss 120B needs 96GB or more. Model list checked on Hugging Face and the Ollama library on October 4, 2026.
Do MoE models like Gemma 4 26B A4B or Qwen 3.6 35B A3B need less RAM?
No. Only 3B–4B parameters are active per token, which makes them fast, but all experts must stay in memory. Plan RAM for the full 26B or 35B weights. The real memory saving is their small KV cache at long context.
Can an 8GB Mac run a local LLM?
Only small models. 1B–4B text models at Q4, such as Llama 3.2 3B or Qwen3 4B, run with short context, because macOS itself needs several gigabytes. Multimodal models like Gemma 4 E4B already ship as files of about 10GB in Ollama. For regular local AI, 16GB is the practical minimum.
Does MLX use less memory than Ollama or LM Studio?
Not fundamentally. All of them load quantized weights, a KV cache, and runtime buffers into the same unified memory. Differences come from the quantization format and default context, so compare them at the same bit width and context length.
How accurate is this calculator?
It gives an estimate, not a benchmark. It adds model weights, KV cache, runtime buffers, optional components like vision or an n-gram table, and your app reserve, targeting at most 85% memory use. Runtime version, model format, and prompt length change actual usage.