Speculative Decoding Optimization Implementations

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tawn19/feat_add_mimo_v25_vision_by_aessedai_pull_request/"> <img alt="feat: add MiMo v2.5 vision by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1teryn8/llama_spec_mtp_support_by_am17an_pull_request/"> <img alt="llama + spec: MTP Support by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x6mlby/add_nemotron_super_35_vl_and_nemotron_bolt_74b/"> <img alt="Add Nemotron Super 3.5 VL and Nemotron

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5odh2/common_add_specdraftnubatch_by_ggerganov_pull/"> <img alt="common : add --spec-draft-n-ubatch by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tr0end/vllm_pr_adding_native_hip_w4a16_kernel_was_merged/"> <img alt="vLLM PR adding native HIP W4A16

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s9lge6/llama_rotate_activations_for_better_quantization/"> <img alt="llama : rotate activations for better