PrismML — Announcing 1-bit Bonsai: The First Commercially Viable 1-bit LLMs

<!-- SC_OFF --><div class="md"><p>This is nuts.</p> <p><a href="https://huggingface.co/prism-ml/Bonsai-8B-gguf">prism-ml/Bonsai-8B-gguf · Hugging Face</a></p> <p>has anyone tested

<!-- SC_OFF --><div class="md"><p>Just been playing around with PrismML's 1-bit 8B LLM and its legit. Now the question is can turboquant be used with it? seemingly yes? </p>

<a href="https://news.ycombinator.com/item?id=49732931">Comments</a>

&#32; submitted by &#32; <a href="https://www.reddit.com/user/yogthos"> /u/yogthos </a> <br /> <span><a href="https://prismml.com/news/bonsai-27b">[link]</a></span> &#32; <span><a

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s59rct/rys_part_3_llms_think_in_geometry_not_language/"> <img alt="RYS Part 3: LLMs think in geometry, not

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s5cggh/google_turboquant_blew_up_for_kv_cache_heres/"> <img alt="Google TurboQuant blew up for KV cache.

<!-- SC_OFF --><div class="md"><p>can someone please eli5 bonsai for me?</p> <p>I understand from a basic perspective how quantization works, but I always like learning more, and

<!-- SC_OFF --><div class="md"><blockquote> <p><strong>WARNING: wait before download from HF: I just realised my upload of the new versions with the additional fix in the chat