Mixture-of-Experts (MoE) models only use a small part of their parameters for each token, so most of the model can live in system RAM instead of GPU VRAM. With an 8–16GB graphics card and 64GB of DDR5, 30B–35B MoE models run comfortably. With 128GB, 100B-class MoE models become possible. Capacity decides what fits; dual-channel bandwidth decides how fast it runs.
What Is a Mixture-of-Experts Model?
A traditional "dense" model uses every parameter for every token it generates. A Mixture-of-Experts model splits much of its network into many smaller "experts," and a router picks only a few of them for each token.
You can usually spot an MoE model from its name. Qwen 3.6 35B-A3B has 35 billion parameters in total, and "A3B" means about 3 billion are active per token. Other popular examples include Gemma 4 26B-A4B and gpt-oss 20B (about 21 billion total, 3.6 billion active).
| Dense Model | MoE Model | |
|---|---|---|
| Memory needed | All parameters | All parameters (same as dense) |
| Compute per token | All parameters | Only the active experts |
| Runs well partly from system RAM? | Slows down a lot | Yes, much better |
Why MoE Makes System RAM So Valuable
The catch with MoE is that the whole model still has to sit somewhere in memory. A 30B-class MoE model at Q4 is about 20GB, which is too big for most 8–16GB graphics cards.
The solution is expert offloading. llama.cpp, the engine behind many popular local AI apps, can keep the parts used on every token, such as attention layers and shared weights, on the GPU, and leave the expert weights in system RAM. Because only a few experts are used per token, the CPU reads only a small slice of the model each time, and the model stays responsive.
How Much DDR5 Do You Need?
| Your GPU | System RAM | What You Can Run (Q4) |
|---|---|---|
| No GPU / integrated graphics | 32 GB | Small MoE models such as gpt-oss 20B, at modest speed |
| 8 GB VRAM | 64 GB | 30B–35B MoE models with expert offload |
| 12–16 GB VRAM | 64 GB | 30B–35B MoE models with long context, or two models at once |
| 16–24 GB VRAM | 128 GB (4×32GB) | 100B-class MoE models such as gpt-oss 120B (~65GB) or Qwen 3.5 122B (~81GB) |
Capacity First, Then Bandwidth
When expert weights live in system RAM, every generated token reads part of them from DDR5. That makes memory bandwidth the speed limit.
- Always run dual-channel. Two matched modules double the bandwidth of one. DDR5-6000 in dual-channel delivers about 96GB/s in theory (6,000 MT/s × 8 bytes × 2 channels).
- Higher MT/s helps. Moving from DDR5-4800 to DDR5-6000 raises peak bandwidth by about 25%.
- Tighter timings are a bonus, not the priority. See A Complete Guide to Memory Timings.
Recommended Silicon Power DDR5 Kits for MoE Workloads
Zenith RGB DDR5-6000 CL30 64GB (2×32GB)
Low-latency 6000 MT/s for the fastest offloaded token generation, with AMD EXPO and Intel XMP 3.0.
Value Gaming DDR5-6000 CL30 64GB (2×32GB)
The same speed and latency in a clean, non-RGB design.
Pulse Gaming DDR5-6000 CL38 64GB (2×32GB)
The most affordable way to reach 64GB at 6000 MT/s.
US75 NVMe SSD
MoE models are large downloads. A fast Gen4 drive loads a 20GB model in a few seconds.
Dense or MoE: Which Should You Choose?
- Your GPU has enough VRAM for a dense model: a dense 27B model is simple to run and very consistent on long documents.
- Your GPU is small but you have plenty of RAM: an MoE model with expert offload is usually the strongest option.
- You want to try very large models: MoE is the only practical route on a desktop PC.
- MoE models need memory for all parameters but compute only a few billion per token.
- Expert offloading lets DDR5 hold most of the model while the GPU handles the rest.
- 64GB (2×32GB) DDR5 is the sweet spot; 128GB opens up 100B-class MoE models.
- Dual-channel and higher MT/s directly increase offloaded generation speed.
Frequently Asked Questions
Do MoE models need less memory than dense models?
No. They need memory for all their parameters. What they save is compute per token, which is why they still run quickly when the expert weights sit in system RAM.
Is DDR4 good enough for MoE offloading?
It works, but DDR4 has much less bandwidth than DDR5, so offloaded models generate tokens more slowly. If you are building a new PC for local AI, choose DDR5.
Should I buy 2×32GB or 4×16GB?
2×32GB. It gives you 64GB in two slots, usually runs at higher speed, and leaves two slots free. If you later want 128GB, buying the same kit again gives you the best chance of stable operation.
How do I know if a model is MoE?
Look for a name like "35B-A3B" or "26B-A4B". The first number is total parameters and the "A" number is the active parameters per token. The model card on Ollama or Hugging Face will also say "Mixture of Experts".