Patch release v5.12.1

<p>Small patch dedicated to optimizing gemma4, fixing inference with <code>use_cache=False</code> due to k/v states sharing between layers, as well as conversion mappings for some

<h2>What's Changed</h2> <p>Another fix for qwen vl models that prevented correctly loading the associated model type - this works together with <a class="issue-link js-issue-link"

<h1>Patch release v5.14.1</h1> <p>This patch solves a few issues which appeared when integrating Inkling model, most notably an issue affecting models using EncoderDecoderCache

<h1>Patch release v5.6.2</h1> <p>Qwen 3.5 and 3.6 MoE (text-only) were broken when using with FP8. It should now work again with this 🫡</p> <ul> <li>Fix configuration reading and

<p>Small patch release to fix <code>device_map</code> support for Gemma4! It contains the following commit:</p> <ul> <li>[gemma4] Fix device map auto (<a class="issue-link

<h1>Release v5.20.1</h1> <p>Special surprise including the new model Beam from Reflection AI 🥳</p> <a

<h1>Patch release v5.8.1</h1> <p>This release is mainly to fix the Deepseek V4 integration!!!</p> <a