NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

Open Source Model Releases

BACKGROUND
4 SIGNALSFIRST DETECTED 22 March 2026UPDATED 7 May 2026
The NewsHive View

What started in late March as a single, quietly posted model release has, by May, become a small but coherent picture of where the uncensored open-source community is pushing its energy. On 22 March, a LocalLLaMA member dropped details on something called Nemotron-Cascade 2 Uncensored — Mac-only, two weight classes, 10GB hitting 66% on MMLU and 18GB clearing 82%. That 16-point gap between the two variants is the most interesting number in the original post, suggesting the efficiency curve steepens sharply as you add memory headroom, and that whoever built this was optimising for Apple Silicon deployment specifically — not an afterthought, but the entire design premise. Then, on 7 May, a second but distinct signal appeared: Qwen3.6 27B Uncensored Heretic v2, a fine-tune preserving all 15 Multi-Token Prediction heads with a KL divergence of just 0.0021, recording only 6 refusals out of 100 attempts, and shipping in safetensors, GGUFs, and NVFP4 formats. Two models, two different base architectures, two different communities — but the same underlying instinct: strip the guardrails, preserve the capability, and make it run on the hardware people actually own.

If confirmed, here is what this means. The uncensored fine-tune pipeline has matured to a point where practitioners are no longer just removing safety layers — they are doing so with measurable precision. A KLD of 0.0021 is not an accident; that is someone carefully monitoring distributional drift to ensure the base model's reasoning capacity survives the alignment removal intact. Six refusals in a hundred is a reproducible benchmark, not a vibe. And the Nemotron work targeting Mac hardware signals that the community has internalised Apple Silicon as a serious inference platform, not a hobbyist curiosity. Taken together, these two releases suggest the gap between open-source uncensored models and their aligned commercial counterparts is narrowing on capability metrics while the deployment friction — for both Mac and NVFP4 GPU users — continues to fall. Enterprises building internal tools on private data, security researchers needing uninhibited model responses, and developers prototyping without commercial API constraints all benefit directly. The second-order effect is pressure on foundation model labs to justify their safety layers more rigorously, because the community is now demonstrating, with numbers, what the guardrail tax actually costs.

Watch for independent MMLU verification of the Nemotron-Cascade 2 18GB variant, and for any third-party reproduction of the Qwen3.6 Heretic v2 refusal rate — if either holds up under scrutiny, the technical claims here become significantly harder to dismiss.

How the story developed
13 Jul
Mellum2 with MTP?
OPINION · WHAT · LocalLLaMA
Other feeds and industry voices
16 Apr
Qwen3.6-35B-A3B released!

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1sn3izh/qwen3635ba3b_released/"> <img alt="Qwen3.6-35B-A3B released!"

OPINION · WHAT · LocalLLaMAOPEN STORY
18 May
30 Mar
Qwen3.5 Omni - Qwen’s latest generation of fully omnimodal LLM

<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1s7rcwr/qwen35_omni_qwens_latest_generation_of_fully/"> <img alt="Qwen3.5 Omni - Qwen’s latest generation

OPINION · WHAT · singularityOPEN STORY
6 May
2.5x faster inference with Qwen 3.6 27B using MTP - Finally a viable option for local agentic coding - 262k context on 48GB - Fixed chat template - Drop-in OpenAI and Anthropic API endpoints

<!-- SC_OFF --><div class="md"><blockquote> <p><strong>WARNING: wait before download from HF: I just realised my upload of the new versions with the additional fix in the chat

OPINION · HOW · LocalLLaMAOPEN STORY
9 May
DeepSeek V4 paper full version is out, FP4 QAT details and stability tricks [D]

<!-- SC_OFF --><div class="md"><p>DeepSeek dropped the full V4 paper this week. preview from april was 58 pages, this version adds a lot of technical depth.</p> <p>What stood out

OPINION · WHEN · MachineLearningOPEN STORY
24 Mar
Distilled qwen 3.5 27b is surprisingly good at driving Cursor.

<!-- SC_OFF --><div class="md"><p>I'm using this <a href="https://huggingface.co/Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-GGUF">opus 4.6 distilled version of

OPINION · HOW · LocalLLaMAOPEN STORY
8 Apr
Napkin math: KV cache for Llama 3.1 at 128K context is ~64GB per decode request, and that's after GQA

<!-- SC_OFF --><div class="md"><p>Every output token the model generates requires reading the entire KV cache from High Bandwidth Memory.</p> <p>Here's what that actually looks

OPINION · WHAT · LocalLLaMAOPEN STORY
19 May
bytedance released an open source model that attempts to do just about anything with only 3b parameters

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1thkwgk/bytedance_released_an_open_source_model_that/"> <img alt="bytedance released an open source model

OPINION · WHAT · LocalLLaMAOPEN STORY
Sources
LocalLLaMA×4

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →