mistralai_Mistral-Medium-3.5-128B-Q3_K_M experiences on 3x3090

<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1szno73/mistral_medium_35_a_reliability_first_open_source/"> <img alt="Mistral Medium 3.5: A reliability

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t09anw/mistral_medium_35_128b_mlx_4bit_70_gb/"> <img alt="Mistral medium 3.5 128B, MLX 4bit, ~70 GB"

<!-- SC_OFF --><div class="md"><p>All ggufs were broken, resulting in bad outputs, especially at long context.</p> <p>Anyway, it is fixed now: <a

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sz1qer/mistralaimistralmedium35128b_hugging_face/"> <img alt="mistralai/Mistral-Medium-3.5-128B · Hugging