Higher quants are so much better

<!-- SC_OFF --><div class="md"><p>Some people say they’d never go under Q8, and others say they find Q3 acceptable! What’s your take?</p> </div><!-- SC_ON --> &#32; submitted by

<!-- SC_OFF --><div class="md"><p>I'm genuinely unsure if I'm doing something wrong, or if the model is just worse, despite the community enthusiasm. I tend to use it with pi

<!-- SC_OFF --><div class="md"><p>I am currently on an m3 mbp with 24gb ram. For regular python and django work the machine is perfect and i have no need to upgrade for speed. but

<!-- SC_OFF --><div class="md"><p>I see lot of people prefer to stick different quants, like bartowski, LMstudio, gglm-org and other ones</p> <p>but why if unsloth does the job

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sa4lzt/i_benchmarked_quants_of_qwen_3_6b_from_q2q8_heres/"> <img alt="I benchmarked quants of Qwen 3 .6b