GGML Performance Optimization

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tr0end/vllm_pr_adding_native_hip_w4a16_kernel_was_merged/"> <img alt="vLLM PR adding native HIP W4A16

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sn2hjg/ggml_add_graph_reused_by_am17an_pull_request/"> <img alt="ggml: add graph_reused by am17an · Pull

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x8bqqs/cuda_faster_mmvq_for_lowbit_types_by_am17an_pull/"> <img alt="CUDA: faster MMVQ for low-bit types by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s9lge6/llama_rotate_activations_for_better_quantization/"> <img alt="llama : rotate activations for better

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t67lvx/feat_add_mimo_v25_model_support_by_aessedai_pull/"> <img alt="feat: Add Mimo v2.5 model support by

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it