Are there ways to set up llama-swap so that competing model requests are queued

<!-- SC_OFF --><div class="md"><p>I have been using llama.cpp to run some models recently. For example, I've been running GLM-4.7-Flash with this command <code>.\llama-server.exe

<!-- SC_OFF --><div class="md"><p>Hi,</p> <p>I'm running a local server with three AMD MI50. Tensor parallelism is not an option since it's very slow with PCIe 3.0 and those cards

<!-- SC_OFF --><div class="md"><p><a

<!-- SC_OFF --><div class="md"><p>currently in order to use MTP one needs to enable it in the starting argument of llama server.</p> <p>--spec-type draft-mtp<br />

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<!-- SC_OFF --><div class="md"><p>Is there an easy way to know if a model is using CPU/RAM (and not only GPU/VRAM)?<br /> (I think standard verbose output, which got shorter, says

<!-- SC_OFF --><div class="md"><p>I keep running into OOM errors when i try to run a local llama model and do anything else GPU-heavy (gaming, video, whatever). I usually just

<!-- SC_OFF --><div class="md"><p>So this is probably a pretty common thing, but I just want to ask in case am not missing something. I have pretty much no knowledge but trying to