NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

CUDA: add fast walsh-hadamard transform by am17an · Pull Request #23615 · ggml-o

BACKGROUND
5 SIGNALSFIRST DETECTED 25 May 2026
Narrative synthesis pending — 5 signals collected.
How the story developed
Other feeds and industry voices
30 Jul
PR for running Ternary-Bonsai-8B-Q2_0.gguf in llama.cpp with CUDA support just got merged

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vau4dh/pr_for_running_ternarybonsai8bq2_0gguf_in/"> <img alt="PR for running Ternary-Bonsai-8B-Q2_0.gguf in

OPINION · WHAT · LocalLLaMAOPEN STORY
18 May
llama.cpp MTP support landed - Qwen3.6 27B at 2.44× on a Strix Halo, 2.17× on a RTX 3090 rig

<!-- SC_OFF --><div class="md"><p>PR #22673 (commit 4f13cb7) landed MTP speculative decoding in mainline llama.cpp on May 16. I tested it on two separate rigs.</p> <p>Qwen3.6 27B,

OPINION · WHAT · LocalLLaMAOPEN STORY
25 Apr
CUDA: reduce MMQ stream-k overhead by JohannesGaessler · Pull Request #22298 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by

OPINION · WHAT · LocalLLaMAOPEN STORY
1 Apr
llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s9lge6/llama_rotate_activations_for_better_quantization/"> <img alt="llama : rotate activations for better

OPINION · WHAT · LocalLLaMAOPEN STORY
29 Mar
Optimize MOE GEMV kernel for BS > 1. by gaugarg-nv · Pull Request #20905 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s71d3f/optimize_moe_gemv_kernel_for_bs_1_by_gaugargnv/"> <img alt="Optimize MOE GEMV kernel for BS &gt; 1.

OPINION · WHAT · LocalLLaMAOPEN STORY
10 May
NCCL-Free Tensor Parallelism on Dual Blackwell PCIe llama.cpp b9095 released!

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it

OPINION · WHAT · LocalLLaMAOPEN STORY
28 Apr
ggml-cuda: add flash-attn support for DKQ=320/DV=256 with ncols2=32 (… by lnigam · Pull Request #22286 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1syfenw/ggmlcuda_add_flashattn_support_for_dkq320dv256/"> <img alt="ggml-cuda: add flash-attn support for

OPINION · WHAT · LocalLLaMAOPEN STORY
7 May
feat: Add Mimo v2.5 model support by AesSedai · Pull Request #22493 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t67lvx/feat_add_mimo_v25_model_support_by_aessedai_pull/"> <img alt="feat: Add Mimo v2.5 model support by

OPINION · WHAT · LocalLLaMAOPEN STORY
Sources
LocalLLaMA×5

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →