ggml: backend-agnostic tensor parallelism by JohannesGaessler · Pull Request #19

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vtgyzf/draft_open_pr_avx2_speed_up_large_batch_size/"> <img alt="[Draft - Open PR] AVX2: Speed up large

<!-- SC_OFF --><div class="md"><p>b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL</p> <p>If youre on dual Blackwell gpus this look like it

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5skta/cuda_hip_gdn_chunked_kernel_by_am17an_pull/"> <img alt="cuda, hip: GDN chunked kernel by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1x5odh2/common_add_specdraftnubatch_by_ggerganov_pull/"> <img alt="common : add --spec-draft-n-ubatch by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t67lvx/feat_add_mimo_v25_model_support_by_aessedai_pull/"> <img alt="feat: Add Mimo v2.5 model support by

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1teryn8/llama_spec_mtp_support_by_am17an_pull_request/"> <img alt="llama + spec: MTP Support by am17an ·

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s71d3f/optimize_moe_gemv_kernel_for_bs_1_by_gaugargnv/"> <img alt="Optimize MOE GEMV kernel for BS &gt; 1.

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1svdjfa/cuda_reduce_mmq_streamk_overhead_by/"> <img alt="CUDA: reduce MMQ stream-k overhead by