NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

b10481: CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843)

BACKGROUND
2 SIGNALSFIRST DETECTED 18 August 2026
Narrative synthesis pending — 2 signals collected.
How the story developed
17 Oct
b11713: CUDA: faster MMVQ for low-bit types (#30517)
REPORT · WHAT · GitHub: llama.cpp
1.8
Other feeds and industry voices
17 Oct
CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x8bqqs/cuda_faster_mmvq_for_lowbit_types_by_am17an_pull/"> <img alt="CUDA: faster MMVQ for low-bit types by

OPINION · WHAT · LocalLLaMAOPEN STORY
15 Oct
b11632: cuda, hip: GDN chunked kernel (#29353)

<ul> <li>cuda, hip: GDN chunked kernel</li> </ul> <p>Ported-from: <a class="issue-link js-issue-link"

REPORT · WHAT · GitHub: llama.cppOPEN STORY
19 Oct
b11730: cuda: cap MMQ Stream-K blocks at available work (#30553)

<ul> <li>cuda: cap Stream-K blocks at the number of k-blocks</li> </ul> <p>Stream-K normally launches one CUDA block per SM. For small matrices,<br /> this can exceed the total

REPORT · WHAT · GitHub: llama.cppOPEN STORY
25 Apr
CUDA: reduce MMQ stream-k overhead by JohannesGaessler · Pull Request #22298 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by

OPINION · WHAT · LocalLLaMAOPEN STORY
4 Oct
b11399: CUDA: refactor swizzling code (#29612)

<ul> <li> <p>CUDA: refactor swizzling code</p> </li> <li> <p>fix templates/loop bounds</p> </li> </ul>

REPORT · WHAT · GitHub: llama.cppOPEN STORY
14 Oct
cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

OPINION · WHAT · LocalLLaMAOPEN STORY
5 Oct
b11422: cuda: use the vector lightning indexer kernel on MUSA (#29990)

<ul> <li>cuda: stage the lightning indexer queries in head passes for MUSA</li> </ul> <p>MUSA archs 21 and 22 cap static shared memory at 28 KB, and the tile<br /> kernel staged

REPORT · WHERE · GitHub: llama.cppOPEN STORY
Sources
GitHub: llama.cpp×2

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →