Qwen with cache offload vLLM

<!-- SC_OFF --><div class="md"><p>I dont have good experience running q4_k_m, the difference to q6 is &quot;a few errors an hour&quot; to &quot; a few errors every couple of

<!-- SC_OFF --><div class="md"><p>I'd jump on runpod and ssh in to test my workloads, but they don't have it.</p> <p>Would love to know how well this runs, particularly as context

<!-- SC_OFF --><div class="md"><p>With practically all of LocalLlama glazing Qwen 3.5/3.6 for it's coding skills. Along with the fact that Alibaba themselves are focusing on

<!-- SC_OFF --><div class="md"><p>In case it helps anyone I'm sharing the config I am using for Qwen3-5-122B-A10B-NVFP4 deployed on a single 6000 Pro.</p> <p><a

<!-- SC_OFF --><div class="md"><p>I'm genuinely unsure if I'm doing something wrong, or if the model is just worse, despite the community enthusiasm. I tend to use it with pi