New Release of ROCm based MLX LLM Engine - lemon-mlx-engine

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1ww49o9/amd_ryzen_ai_developer_platform_os_updated_with/"> <img alt="AMD Ryzen AI Developer Platform OS

<!-- SC_OFF --><div class="md"><p>So i recently updated LMstudio after a long pause and updated my llama.cpp runtimes too.. i was shocked.. i thought maybe something like

<!-- SC_OFF --><div class="md"><p>Just ran some llama-bench comparisons between ROCm and Vulkan backends on my Strix Halo system. Vulkan came out ahead, which surprised me.</p>

<!-- SC_OFF --><div class="md"><p><a href="https://www.phoronix.com/news/ROCm-7.13-Released">https://www.phoronix.com/news/ROCm-7.13-Released</a> Quote: ...new optimizations for

<!-- SC_OFF --><div class="md"><p>Might be another option of us local LLM folks. I am very curious on the price. </p> <p><a

<!-- SC_OFF --><div class="md"><p>We know that using ROCm is a disgrace compared to CUDA, especially if you don't have &quot;current&quot; hardware. </p> <p>Guess what? I just

<!-- SC_OFF --><div class="md"><p><a href="https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15">https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15</a></p>