Choosing an abliterated version of Gemma 4 31B and 26B-A4B

<!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF">https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF</a></p> <p><a

<!-- SC_OFF --><div class="md"><p>What are your experiences with Gemma 4's QAT versions compared to their regular ones? So far I have mostly heard about regressions, but if you

<!-- SC_OFF --><div class="md"><p>I run Gemma 4 26B-A4B locally via Ollama as part of a custom self-hosted AI platform. The platform stores every model interaction in SQLite,

<!-- SC_OFF --><div class="md"><p>I'm genuinely unsure if I'm doing something wrong, or if the model is just worse, despite the community enthusiasm. I tend to use it with pi

<!-- SC_OFF --><div class="md"><p>Some people say they’d never go under Q8, and others say they find Q3 acceptable! What’s your take?</p> </div><!-- SC_ON --> &#32; submitted by

<!-- SC_OFF --><div class="md"><p>Got inspired to try and crack this egg without using heretic.</p> <p>FP16, Q8_0 and Q4_K_M quants, plus the abliteration script for

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tg7s7j/gemma4gembrain31bituncensoredheretic_is_out_now_a/"> <img

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1srhtvg/where_we_are_in_a_year_everything_has_changed/"> <img alt="Where we are. In a year, everything has