<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1srhtvg/where_we_are_in_a_year_everything_has_changed/"> <img alt="Where we are. In a year, everything has
<!-- SC_OFF --><div class="md"><p>Running Llama-3-70B with long contexts and hitting HBM limits constantly. 128K context burns approx 40GB just for KV cache — half the H100 gone
<!-- SC_OFF --><div class="md"><p>I could not find good data points on what speed one could get with a single 5090 and enough DDR4 RAM. </p> <p>My system: AMD EPYC 7532 32core
<!-- SC_OFF --><div class="md"><p>In LM Studio the new Qwen 3.5 models (4b 9b 27b 122b) when analyzing large (more than 50k tokens) texts start to output gibberish. It is not a
<!-- SC_OFF --><div class="md"><blockquote> <p><strong>WARNING: wait before download from HF: I just realised my upload of the new versions with the additional fix in the chat
<!-- SC_OFF --><div class="md"><p>I have experience using llama.cpp on Windows/Linux with 8GB NVIDIA card (384 GB/s bandwidth) and offloading to CPU to run MoE models. I typically
<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t4uj9h/mtp_on_strix_halo_with_llamacpp_pr_22673/"> <img alt="MTP on strix halo with llama.cpp (PR #22673)"
<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1s7rcwr/qwen35_omni_qwens_latest_generation_of_fully/"> <img alt="Qwen3.5 Omni - Qwen’s latest generation
NewsHive monitors these sources continuously. All signal titles above link to the original reporting.
Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →