[D] How does distributed proof of work computing handle the coordination needs o

<!-- SC_OFF --><div class="md"><p>Running Llama-3-70B with long contexts and hitting HBM limits constantly. 128K context burns approx 40GB just for KV cache — half the H100 gone

<!-- SC_OFF --><div class="md"><p>I used to be all-in on cloud APIs. For any side project, I’d just grab an OpenAI or Anthropic key and not think twice. It was convenient. No

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sez79x/towards_a_bitter_lesson_of_optimization_when/"> <img alt="Towards a Bitter Lesson of Optimization:

<!-- SC_OFF --><div class="md"><p><strong>Noam Brown</strong> — OpenAI Research Scientist and co-creator of o1, Libratus, and Cicero — sat down with Dwarkesh Patel for a 1h 20m

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s59rct/rys_part_3_llms_think_in_geometry_not_language/"> <img alt="RYS Part 3: LLMs think in geometry, not

<!-- SC_OFF --><div class="md"><p>doing infrastructure evaluation for inference workloads and running into the same problem everywhere: every platform publishes p50 cold start

<!-- SC_OFF --><div class="md"><p>i am just getting into ai and still learning, and i am trying to figure out if there is even such a thing yet as a desktop setup that can run

<!-- SC_OFF --><div class="md"><p>Long time Claude Opus user, but after the recent session limit changes by Anthropic, I am seriously considering trying Chinese models for coding.