Opencode + Local Models + Apple MLX = ??

<!-- SC_OFF --><div class="md"><p>There are plenty of &quot;bro trust me, this model is better for coding&quot; discussions out there. I wanted to replace the vibes with actual

<!-- SC_OFF --><div class="md"><p>Running Llama-3-70B with long contexts and hitting HBM limits constantly. 128K context burns approx 40GB just for KV cache — half the H100 gone

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1srhtvg/where_we_are_in_a_year_everything_has_changed/"> <img alt="Where we are. In a year, everything has

<!-- SC_OFF --><div class="md"><blockquote> <p><strong>WARNING: wait before download from HF: I just realised my upload of the new versions with the additional fix in the chat

<!-- SC_OFF --><div class="md"><p>Wrote a deep dive on <strong>FlashAttention-4 (03/05/2026)</strong> that's relevant for anyone thinking about inference performance.</p>

<!-- SC_OFF --><div class="md"><p>Hi,</p> <p>I taught Computer Science for 30 years in a French School of Electrical Engineering, Computer Science Department.</p> <p>I recently

<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1s7rcwr/qwen35_omni_qwens_latest_generation_of_fully/"> <img alt="Qwen3.5 Omni - Qwen’s latest generation

<!-- SC_OFF --><div class="md"><p>Every output token the model generates requires reading the entire KV cache from High Bandwidth Memory.</p> <p>Here's what that actually looks