Are super tiny LLMs any good?

<!-- SC_OFF --><div class="md"><p>Hi. What do you think is the smallest Open model, as of Spring 2026, that can match/beat OpenAI GPT 4o Mini in the broadest sense possible?</p>

<!-- SC_OFF --><div class="md"><p>I need SOTA ai at like 2k TPS with tiny latency so that I can get time to first answer token under 3 seconds for real time replies with full COT

<!-- SC_OFF --><div class="md"><p>Long time Claude Opus user, but after the recent session limit changes by Anthropic, I am seriously considering trying Chinese models for coding.

<!-- SC_OFF --><div class="md"><p>There are so many options now — GPT, Claude, Gemini, etc.</p> <p>I find myself switching depending on what I’m doing (coding, writing, research),

<!-- SC_OFF --><div class="md"><p>I know qwen 3.5 4b is great but a bit too large and miniPCM5 1b is great for agentic use but not so great for multilingual natural language

<!-- SC_OFF --><div class="md"><p>Hi everyone </p> <p>I’m new to this community and just starting out with local LLMs. I’m using a MacBook M4 Air, so my hardware is somewhat

<!-- SC_OFF --><div class="md"><p>Hello. I'm ordering a small piece of software for personal needs (like a virtual keyboard or an expression recognition action app). I asked

<!-- SC_OFF --><div class="md"><p>Hello everyone,</p> <p>I’m looking for an AI that runs entirely locally on my PC, without needing an internet connection.</p> <p>I’d like it to