NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

llama.cpp fixes to run Bonsai 1-bit models on CPU (incl AVX512) and AMD GPUs

BACKGROUND
1 SIGNALFIRST DETECTED 2 April 2026
Narrative synthesis pending — 1 signal collected.
How the story developed
Other feeds and industry voices
10 May
NCCL-Free Tensor Parallelism on Dual Blackwell PCIe llama.cpp b9095 released!

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it

OPINION · WHAT · LocalLLaMAOPEN STORY
1 Apr
Can't run Bonsai-4B.gguf (by PrismML) on llama.cpp, is there a solution?

<!-- SC_OFF --><div class="md"><p>I can't run the recently released 1-bit Bonsai-4B.gguf <a href="https://huggingface.co/prism-ml/Bonsai-4B-gguf/tree/main">model</a> in llama.cpp.

OPINION · HOW · LocalLLaMAOPEN STORY
30 Jul
PR for running Ternary-Bonsai-8B-Q2_0.gguf in llama.cpp with CUDA support just got merged

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vau4dh/pr_for_running_ternarybonsai8bq2_0gguf_in/"> <img alt="PR for running Ternary-Bonsai-8B-Q2_0.gguf in

OPINION · WHAT · LocalLLaMAOPEN STORY
14 Oct
cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

OPINION · WHAT · LocalLLaMAOPEN STORY
12 May
feat: add MiMo v2.5 vision by AesSedai · Pull Request #22883 · ggml-org/llama.cpp

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tawn19/feat_add_mimo_v25_vision_by_aessedai_pull_request/"> <img alt="feat: add MiMo v2.5 vision by

OPINION · WHAT · LocalLLaMAOPEN STORY
30 Mar
llama.cpp at 100k stars

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s7z7hj/llamacpp_at_100k_stars/"> <img alt="llama.cpp at 100k stars"

OPINION · WHAT · LocalLLaMAOPEN STORY
13 Apr
FYI, Step 3.5 Flash has better perf and context is 1/4 the price in llama.cpp

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

OPINION · WHAT · LocalLLaMAOPEN STORY
14 May
Ollama Pre-Release Switches From Building on GGML to Using llama.cpp Directly

<!-- SC_OFF --><div class="md"><p><a href="https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15">https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15</a></p>

OPINION · HOW · LocalLLaMAOPEN STORY
Sources
LocalLLaMA

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →