llama.cpp - NVFP4 native support on Blackwell from now - b8967

<!-- SC_OFF --><div class="md"><p>As in title - NVFP4 + MTP at once on llama.cpp<br /> <a

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s7z7hj/llamacpp_at_100k_stars/"> <img alt="llama.cpp at 100k stars"

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tawn19/feat_add_mimo_v25_vision_by_aessedai_pull_request/"> <img alt="feat: add MiMo v2.5 vision by

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1teryn8/llama_spec_mtp_support_by_am17an_pull_request/"> <img alt="llama + spec: MTP Support by am17an ·

<!-- SC_OFF --><div class="md"><p><a href="https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15">https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15</a></p>

<!-- SC_OFF --><div class="md"><p>I have been using it through vllm and faster than other quant types for my RTX 5060ti. Do we have this in llama.cpp yet ?</p> </div><!-- SC_ON

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t3guzw/llamacpp_mtp_support_now_in_beta/"> <img alt="Llama.cpp MTP support now in beta!"