<!-- SC_OFF --><div class="md"><p>At q8 its about 4x as fast as fp16 with transformers.</p> <p><a
<!-- SC_OFF --><div class="md"><p><a href="https://huggingface.co/microsoft/bitnet-embedding-0.6b">https://huggingface.co/microsoft/bitnet-embedding-0.6b</a> Dang, no model
<a href="https://news.ycombinator.com/item?id=47933236">Comments</a>
Microsoft's MIT licensed VibeVoice speech-to-text model (think Whisper with speaker diarization) is really good - my notes on running the 5.71GB 4bit MLX conversion on an M5
NewsHive monitors these sources continuously. All signal titles above link to the original reporting.
Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →