CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/l

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s71d3f/optimize_moe_gemv_kernel_for_bs_1_by_gaugargnv/"> <img alt="Optimize MOE GEMV kernel for BS &gt; 1.

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s9lge6/llama_rotate_activations_for_better_quantization/"> <img alt="llama : rotate activations for better

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uoxdp8/ggmlcpu_use_ue4m3_lut_in_arm_nvfp4_dot_product_by/"> <img alt="ggml-cpu: use UE4M3 LUT in ARM NVFP4

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1syfenw/ggmlcuda_add_flashattn_support_for_dkq320dv256/"> <img alt="ggml-cuda: add flash-attn support for

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sn2hjg/ggml_add_graph_reused_by_am17an_pull_request/"> <img alt="ggml: add graph_reused by am17an · Pull

<ul> <li> <p>CUDA: faster MMVQ for low-bit types</p> </li> <li> <p>ggml-cuda: hip: small nwarps GCN fix on Q3_K(ncols=2,3), Q6_K(ncols=4)</p> </li> </ul> <hr /> <p>Co-authored-by: