<!-- SC_OFF --><div class="md"><p>PR #22673 (commit 4f13cb7) landed MTP speculative decoding in mainline llama.cpp on May 16. I tested it on two separate rigs.</p> <p>Qwen3.6 27B,
<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vau4dh/pr_for_running_ternarybonsai8bq2_0gguf_in/"> <img alt="PR for running Ternary-Bonsai-8B-Q2_0.gguf in
<!-- SC_OFF --><div class="md"><p>sched : reintroduce less synchronizations during split compute (<a href="https://github.com/ggml-org/llama.cpp/pull/20793">#20793</a>)</p> <ul>
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t67lvx/feat_add_mimo_v25_model_support_by_aessedai_pull/"> <img alt="feat: Add Mimo v2.5 model support by
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1teryn8/llama_spec_mtp_support_by_am17an_pull_request/"> <img alt="llama + spec: MTP Support by am17an ·
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t4uj9h/mtp_on_strix_halo_with_llamacpp_pr_22673/"> <img alt="MTP on strix halo with llama.cpp (PR #22673)"
NewsHive monitors these sources continuously. All signal titles above link to the original reporting.
Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →