Speculative decoding in a tools call

<!-- SC_OFF --><div class="md"><p>I have totally missed the boat on speculative decoding.</p> <p>Today when generating some code again for the frontend i found myself staring down

&#32; submitted by &#32; <a href="https://www.reddit.com/user/undefdev"> /u/undefdev </a> <br /> <span><a

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1smeotw/ddtreemlx_treebased_speculative_decoding_for/"> <img alt="DDTree-MLX — Tree-based speculative

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sexsvd/dflash_block_diffusion_for_flash_speculative/"> <img alt="DFlash: Block Diffusion for Flash

<!-- SC_OFF --><div class="md"><p>Anyone who knows stuff about fpgas:</p> <p>- What max model size can one be designed for (I've read 20-30m parameters max, is it possible to go