Llama-server: is it bleeding to CPU/RAM?

<!-- SC_OFF --><div class="md"><p>I have been using llama.cpp to run some models recently. For example, I've been running GLM-4.7-Flash with this command <code>.\llama-server.exe

<!-- SC_OFF --><div class="md"><p>Noob here, Running Qwen3.6 35B A3B in LM Studio on a 3080 10GB + Ryzen 5 3600 on Windows 10.</p> <p>Tried some unsloth quants with identical

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t4uj9h/mtp_on_strix_halo_with_llamacpp_pr_22673/"> <img alt="MTP on strix halo with llama.cpp (PR #22673)"

<!-- SC_OFF --><div class="md"><p>Hi,</p> <p>I taught Computer Science for 30 years in a French School of Electrical Engineering, Computer Science Department.</p> <p>I recently

<!-- SC_OFF --><div class="md"><p><a

<!-- SC_OFF --><div class="md"><p>I download Qwen local LLama with 1.5B model. The model run very slowly, 0.12 token/s. It seems that model was runned by cpu. Is it the normal

<!-- SC_OFF --><div class="md"><p>Every output token the model generates requires reading the entire KV cache from High Bandwidth Memory.</p> <p>Here's what that actually looks