M5 Ultra 256 running GLM 5.3 Flash 68.8 tok/s

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1wei63j/m2_ultraqwen38_flash_next_update_latest_omlx/"> <img alt="M2 Ultra/Qwen3.8 Flash Next Update -

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vdsmnk/deepseek_v4_iq3xxs_on_m1_ultra_128gb_16_toks_in/"> <img alt="DeepSeek V4 @ IQ3XXS on M1 Ultra 128GB-

<!-- SC_OFF --><div class="md"><p>I’ve managed to get it to run and, with some patches to llama.cpp, I get ~8 tok/s decode and ~30 tok/s prefill on a M1 Max 64GB MacBook.</p>

&#32; submitted by &#32; <a href="https://www.reddit.com/user/locker73"> /u/locker73 </a> <br /> <span><a href="https://matthusby.github.io/agent_coding_bench/">[link]</a></span>

<!-- SC_OFF --><div class="md"><p>What speeds are everyone getting with deepseek v4 flash 0731?</p> <p>I’m getting~200 tps prompt processing / ~11 tps token gen, on 4x5060ti16gb

<!-- SC_OFF --><div class="md"><p>I am currently on an m3 mbp with 24gb ram. For regular python and django work the machine is perfect and i have no need to upgrade for speed. but

<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1v2l6sm/gemini_36_flash_benchmarks/"> <img alt="Gemini 3.6 Flash benchmarks"