Gemma 4 MTP with LlamaCPP

<!-- SC_OFF --><div class="md"><p>In case you haven't heard, Google just released Multi Token Prediction drafters for Gemma 4, a speculative decoding approach that pairs the main

<!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF">https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF</a></p> <p><a

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tijpwl/wip_gemma_4_mtp/"> <img alt="[WIP] Gemma 4 MTP"

<!-- SC_OFF --><div class="md"><p>Hi,</p> <p>has anybody succeeded in running llama.cpp with Gemma 31b dense and Gemma e4b as draft model, and simultaneously inhibit the voice

<!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/google/gemma-4-31B-it-assistant">https://huggingface.co/google/gemma-4-31B-it-assistant</a></p> <p><a

<!-- SC_OFF --><div class="md"><p>Hello, I've seen reviews that gemma 4 31b base is very good at roleplaying. But I can't find the gguf version of the basic gemma 4 anywhere. Only

<!-- SC_OFF --><div class="md"><p>Good morning!</p> <p>I was doing some research yesterday and I came across this Gemma 4 120b a12b coder model:</p> <p><a

<!-- SC_OFF --><div class="md"><p>I normally just chuck my models to LM Studio for a quick test, but it doesn't support video input. Neither does llama.cpp or Ollama.</p> <p>How