NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

How does llama-server pick which MoE experts go on the GPU and which stay on the

BACKGROUND
1 SIGNALFIRST DETECTED 10 May 2026
Narrative synthesis pending — 1 signal collected.
How the story developed
Other feeds and industry voices
23 Jul
Possible to load non shared experts to SSD in llama.cpp?

<!-- SC_OFF --><div class="md"><p>I know llama.cpp can use -cmoe switch to load non shared experts in MoE models to RAM and run by CPU and left the other weights and KV cache on

OPINION · WHAT · LocalLLaMAOPEN STORY
18 May
Llama-server: is it bleeding to CPU/RAM?

<!-- SC_OFF --><div class="md"><p>Is there an easy way to know if a model is using CPU/RAM (and not only GPU/VRAM)?<br /> (I think standard verbose output, which got shorter, says

OPINION · WHO · LocalLLaMAOPEN STORY
3 May
Does running a model (like qwen3.6-27b) on vllm or transformers use less VRAM than llama.cpp?

<!-- SC_OFF --><div class="md"><p>I have been using llama.cpp to run some models recently. For example, I've been running GLM-4.7-Flash with this command <code>.\llama-server.exe

OPINION · HOW · LocalLLaMAOPEN STORY
19 May
Llama-server and MTP

<!-- SC_OFF --><div class="md"><p>currently in order to use MTP one needs to enable it in the starting argument of llama server.</p> <p>--spec-type draft-mtp<br />

OPINION · WHEN · LocalLLaMAOPEN STORY
1 Sept
Round-Robin with llama-server?

<!-- SC_OFF --><div class="md"><p>Hi,</p> <p>I'm running a local server with three AMD MI50. Tensor parallelism is not an option since it's very slow with PCIe 3.0 and those cards

OPINION · WHAT · LocalLLaMAOPEN STORY
Sources
LocalLLaMA

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →