Gemma 4 26B/31B Q4 QAT vs Q4/Q5/Q6/Q8

<!-- SC_OFF --><div class="md"><p>Some people say they’d never go under Q8, and others say they find Q3 acceptable! What’s your take?</p> </div><!-- SC_ON --> &#32; submitted by

<!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF">https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF</a></p> <p><a

<!-- SC_OFF --><div class="md"><p>The only thread was 2 months ago, when the model had just dropped. Since then, more versions from different authors have appeared, and users have

<!-- SC_OFF --><div class="md"><p>I run Gemma 4 26B-A4B locally via Ollama as part of a custom self-hosted AI platform. The platform stores every model interaction in SQLite,

<!-- SC_OFF --><div class="md"><p>I've been playing with Gemma 4 31B for coding tasks since it came out and been genuinely impressed with how capable it is. With the benchmarks

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1srhtvg/where_we_are_in_a_year_everything_has_changed/"> <img alt="Where we are. In a year, everything has

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t79ayh/zlab_released_gemma426ba4bitdflash_anybody_tried/"> <img alt="z-lab released

<!-- SC_OFF --><div class="md"><p>Hey all, I have a long-form context companion.advisor running on qwen 27b through lm studios and openclaw, I really like Gemini for conversations