Patch release v5.10.2

<h2>What's Changed</h2> <p>Another fix for qwen vl models that prevented correctly loading the associated model type - this works together with <a class="issue-link js-issue-link"

<p>Small patch dedicated to optimizing gemma4, fixing inference with <code>use_cache=False</code> due to k/v states sharing between layers, as well as conversion mappings for some

<h1>Patch release v5.12.1</h1> <p>Updated the lower bound for PEFT and a fix for auto tokenizer to properly resolve the mistral tokenizer (when <code>mistral-common</code> is

<p>Small patch release to fix <code>device_map</code> support for Gemma4! It contains the following commit:</p> <ul> <li>[gemma4] Fix device map auto (<a class="issue-link

<h1>Patch release v5.6.2</h1> <p>Qwen 3.5 and 3.6 MoE (text-only) were broken when using with FP8. It should now work again with this 🫡</p> <ul> <li>Fix configuration reading and

<h1>Patch release v5.8.1</h1> <p>This release is mainly to fix the Deepseek V4 integration!!!</p> <a

<h1>Release v5.16.1</h1> <p>This is a special release as we include GLM! (and a few small fixes)</p> <h1>GLM-5.3-Flash</h1> <a

<h1>Release v5.16.1</h1> <p>This is a special release as we include GLM! (and a few small fixes)</p> <h1>GLM-5.3-Flash</h1> <a