<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it
<!-- SC_OFF --><div class="md"><p>I can't run the recently released 1-bit Bonsai-4B.gguf <a href="https://huggingface.co/prism-ml/Bonsai-4B-gguf/tree/main">model</a> in llama.cpp.
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vau4dh/pr_for_running_ternarybonsai8bq2_0gguf_in/"> <img alt="PR for running Ternary-Bonsai-8B-Q2_0.gguf in
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tawn19/feat_add_mimo_v25_vision_by_aessedai_pull_request/"> <img alt="feat: add MiMo v2.5 vision by
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s7z7hj/llamacpp_at_100k_stars/"> <img alt="llama.cpp at 100k stars"
<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like
<!-- SC_OFF --><div class="md"><p><a href="https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15">https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15</a></p>
NewsHive monitors these sources continuously. All signal titles above link to the original reporting.
Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →