Hypothetical: You can run Qwen 3.5 27b at 10,000 TPS at your house right now.

<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1s6bs6r/taalas_rumoured_to_etch_qwen_35_27b_into_silicon/"> <img alt="Taalas rumoured to etch Qwen 3.5 27B

<!-- SC_OFF --><div class="md"><p>Got Qwen 3.5 27B to 1,103,941 tok/s on 12 nodes with 96 B200 GPUs.</p> <p>At that rate you process 50,000 insurance policy documents in hours

<!-- SC_OFF --><div class="md"><p>I'm genuinely unsure if I'm doing something wrong, or if the model is just worse, despite the community enthusiasm. I tend to use it with pi

<!-- SC_OFF --><div class="md"><p>I run all sorts of models locally, but I only have a 3090ti. With vllm I’m able to batch and get 2-6 parallel streams in low context. That

<!-- SC_OFF --><div class="md"><p>I read this sub every day and I keep seeing benchmarks and discussions focused almost entirely on tokens/s generation speed. Prompt processing

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1srhtvg/where_we_are_in_a_year_everything_has_changed/"> <img alt="Where we are. In a year, everything has

<!-- SC_OFF --><div class="md"><blockquote> <p><strong>WARNING: wait before download from HF: I just realised my upload of the new versions with the additional fix in the chat

<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1s7rcwr/qwen35_omni_qwens_latest_generation_of_fully/"> <img alt="Qwen3.5 Omni - Qwen’s latest generation