<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1syfenw/ggmlcuda_add_flashattn_support_for_dkq320dv256/"> <img alt="ggml-cuda: add flash-attn support for
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tawn19/feat_add_mimo_v25_vision_by_aessedai_pull_request/"> <img alt="feat: add MiMo v2.5 vision by
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s9lge6/llama_rotate_activations_for_better_quantization/"> <img alt="llama : rotate activations for better
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vau4dh/pr_for_running_ternarybonsai8bq2_0gguf_in/"> <img alt="PR for running Ternary-Bonsai-8B-Q2_0.gguf in
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s71d3f/optimize_moe_gemv_kernel_for_bs_1_by_gaugargnv/"> <img alt="Optimize MOE GEMV kernel for BS > 1.
<!-- SC_OFF --><div class="md"><p>PR #22673 (commit 4f13cb7) landed MTP speculative decoding in mainline llama.cpp on May 16. I tested it on two separate rigs.</p> <p>Qwen3.6 27B,
NewsHive monitors these sources continuously. All signal titles above link to the original reporting.
Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →