CUDA: reduce MMQ stream-k overhead by JohannesGaessler · Pull Request #22298 · g

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s71d3f/optimize_moe_gemv_kernel_for_bs_1_by_gaugargnv/"> <img alt="Optimize MOE GEMV kernel for BS &gt; 1.

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x8bqqs/cuda_faster_mmvq_for_lowbit_types_by_am17an_pull/"> <img alt="CUDA: faster MMVQ for low-bit types by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s9lge6/llama_rotate_activations_for_better_quantization/"> <img alt="llama : rotate activations for better

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vau4dh/pr_for_running_ternarybonsai8bq2_0gguf_in/"> <img alt="PR for running Ternary-Bonsai-8B-Q2_0.gguf in

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sn2hjg/ggml_add_graph_reused_by_am17an_pull_request/"> <img alt="ggml: add graph_reused by am17an · Pull

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t67lvx/feat_add_mimo_v25_model_support_by_aessedai_pull/"> <img alt="feat: Add Mimo v2.5 model support by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1syfenw/ggmlcuda_add_flashattn_support_for_dkq320dv256/"> <img alt="ggml-cuda: add flash-attn support for