Built a tiny CLI for Apple’s local AI runtime on Mac

<!-- SC_OFF --><div class="md"><p>I think you already know that macOS has a builtin llm ...</p> <p>it is a small model , 4k context... but maybe fun to play with it .</p> <p>below

<!-- SC_OFF --><div class="md"><p>Even with agent framework DX getting somewhat better - it's still really annoying to build real apps with them. Even a basic in-app agent chatbot

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1t0ea9u/i_built_a_fully_local_meeting_ai_that_runs/"> <img alt="I built a fully local meeting AI that runs

<!-- SC_OFF --><div class="md"><p>Are local 4B models usable on smartphone?</p> <p>Just did a vibe check on a Pixel Pro 10, Gemma 4B vs Qwen 3.5 4B, starting from handheld photos

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s3i83m/fully_local_voice_ai_on_iphone/"> <img alt="Fully local voice AI on iPhone"

<!-- SC_OFF --><div class="md"><p>I have snobbishly long felt that the local models were not 'up to my standards' for local development, or otherwise able to compete with GHCP,

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1s5ardk/i_compressed_all_2023_state_of_the_art_into_an/"> <img alt="I compressed all 2023 State of the Art

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1skqob4/built_a_local_dictation_app_in_rusttauri_that/"> <img alt="Built a local dictation app in Rust/Tauri