DGX Spark test

<!-- SC_OFF --><div class="md"><p>Actually I'm not someone with particularly deep technical knowledge but I want to build a product, and instead of paying Claude a lot of money,

<!-- SC_OFF --><div class="md"><p>Got Qwen 3.5 27B to 1,103,941 tok/s on 12 nodes with 96 B200 GPUs.</p> <p>At that rate you process 50,000 insurance policy documents in hours

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1wvyxzg/new_64gb_dgx_spark_significantly_higher_price_for/"> <img alt="New 64GB DGX Spark. Significantly

<!-- SC_OFF --><div class="md"><p>What’s the highest number of users you’ve realistically served from a single machine?</p> <p>Would be useful to know:</p> <p>* Model +

<!-- SC_OFF --><div class="md"><p>Posting this here since you guys are the more tech-savvy compared to <a href="/r/StableDiffusion">/r/StableDiffusion</a>. </p> <p>I’m looking at

<!-- SC_OFF --><div class="md"><p>Just curious what are your best speeds with that model. The max peak that i have using vllm is 32tps (out) on i think Q4 k_s. Any way to make it

<!-- SC_OFF --><div class="md"><p>Looks like they are sending a dgx spark for $4499. I couldn't find much information on them but I keep getting Instagram ads repeatedly(even

<!-- SC_OFF --><div class="md"><p>I am looking for recommendations on the best way to run local LLMs on NVIDIA DGX Spark.</p> <p>Which stack makes the most sense in practice: