Maybe dumb question, but how do you serve multiple users with the full context l

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s2bne8/context_shifting_sliding_window_rag/"> <img alt="Context Shifting + sliding window + RAG"

<!-- SC_OFF --><div class="md"><p>How do you guys deal with long context, for example while coding, when you’re going back and forth for adjustments or fixing some errors and

<!-- SC_OFF --><div class="md"><p>We all know about context rotting (loss of model accuracy over long context).<br /> Many times I see some saying &quot;try with 32K context and

<!-- SC_OFF --><div class="md"><p>I noticed on the same hardware that I can get 24 x 128k contexts with muse glimmer (30b q8_0 + mmproj+dflash) only gets me 3x 256k or 6x 128k