NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

PSA: llama.cpp now loads MTP tensors by default for any draft-mtp arch, even wit

BACKGROUND
1 SIGNALFIRST DETECTED 29 July 2026
Narrative synthesis pending — 1 signal collected.
How the story developed
Other feeds and industry voices
18 May
llama.cpp MTP support landed - Qwen3.6 27B at 2.44× on a Strix Halo, 2.17× on a RTX 3090 rig

<!-- SC_OFF --><div class="md"><p>PR #22673 (commit 4f13cb7) landed MTP speculative decoding in mainline llama.cpp on May 16. I tested it on two separate rigs.</p> <p>Qwen3.6 27B,

OPINION · WHAT · LocalLLaMAOPEN STORY
10 May
NCCL-Free Tensor Parallelism on Dual Blackwell PCIe llama.cpp b9095 released!

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it

OPINION · WHAT · LocalLLaMAOPEN STORY
6 May
Qwen3.6-27B with MTP grafted on Unsloth UD XL: 2.5x throughput via unmerged llama.cpp PR

<!-- SC_OFF --><div class="md"><p>Hey everyone, I've been working on getting Multi-Token Prediction (MTP) working with quantized GGUFs for Qwen3-27B and the results are pretty

OPINION · HOW · LocalLLaMAOPEN STORY
16 May
llama + spec: MTP Support by am17an · Pull Request #22673 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1teryn8/llama_spec_mtp_support_by_am17an_pull_request/"> <img alt="llama + spec: MTP Support by am17an ·

OPINION · WHAT · LocalLLaMAOPEN STORY
14 May
Ollama Pre-Release Switches From Building on GGML to Using llama.cpp Directly

<!-- SC_OFF --><div class="md"><p><a href="https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15">https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15</a></p>

OPINION · HOW · LocalLLaMAOPEN STORY
5 May
MTP on strix halo with llama.cpp (PR #22673)

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t4uj9h/mtp_on_strix_halo_with_llamacpp_pr_22673/"> <img alt="MTP on strix halo with llama.cpp (PR #22673)"

OPINION · WHAT · LocalLLaMAOPEN STORY
14 Oct
cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

OPINION · WHAT · LocalLLaMAOPEN STORY
14 Oct
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5odh2/common_add_specdraftnubatch_by_ggerganov_pull/"> <img alt="common : add --spec-draft-n-ubatch by

OPINION · WHAT · LocalLLaMAOPEN STORY
Sources
LocalLLaMA

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →