Can we finally run NVFP4 models in llama?

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it

<!-- SC_OFF --><div class="md"><p>Want to use it for coding in OpenCode or similar on my RTX 5060ti 16GB. </p> </div><!-- SC_ON --> &#32; submitted by &#32; <a

<!-- SC_OFF --><div class="md"><p>So I’m testing several models on macOS and I’d like to understand if NVFP4 is the best option to run 4bit models quantized models using mlx. From

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<!-- SC_OFF --><div class="md"><p>I’ve been testing LM Studio on my RTX 5070 Ti (16GB) and Ryzen 9800X3D, running Unsloth Qwen3.5 35B (UD Q4_K_XL).</p> <p>Initially, I thought LM

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uoxdp8/ggmlcpu_use_ue4m3_lut_in_arm_nvfp4_dot_product_by/"> <img alt="ggml-cpu: use UE4M3 LUT in ARM NVFP4

<!-- SC_OFF --><div class="md"><p>I have been using llama.cpp to run some models recently. For example, I've been running GLM-4.7-Flash with this command <code>.\llama-server.exe

<!-- SC_OFF --><div class="md"><p>PR #22673 (commit 4f13cb7) landed MTP speculative decoding in mainline llama.cpp on May 16. I tested it on two separate rigs.</p> <p>Qwen3.6 27B,