Gemma 4 31B (UD-Q8_K_XL) suddenly reports "Exceeds shared memory" at 68k context

<!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF">https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF</a></p> <p><a

<!-- SC_OFF --><div class="md"><p>trying to load Gemma 4. in llm studio on a Windows server 2026 with RTX 3090 24g and 512g ram server. But When I try to load it I get this error

<!-- SC_OFF --><div class="md"><p>Every output token the model generates requires reading the entire KV cache from High Bandwidth Memory.</p> <p>Here's what that actually looks

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sja4rc/gemma_4_insists_its_not_running_locally/"> <img alt="Gemma 4 insists it’s not running locally"

<!-- SC_OFF --><div class="md"><p>I run Gemma 4 26B-A4B locally via Ollama as part of a custom self-hosted AI platform. The platform stores every model interaction in SQLite,

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vmnj9q/weirdly_slow_tps_on_7900_xt_gemma_4_26ba4b_iq3/"> <img alt="Weirdly Slow TPS on 7900 XT, Gemma 4

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<!-- SC_OFF --><div class="md"><p>Hi there !</p> <p>I've been very excited about Gemma 4's release but unfortunately I just can't make it run anywhere !<br /> Both on my phone