Do VLMs in production still use fixed-patch ViTs for their vision capabilities?

<!-- SC_OFF --><div class="md"><p>Hi everyone,</p> <p>I'm a Computer Engineering student working on my final degree project (TFG), and I have around 300 hours to complete it.</p>

<!-- SC_OFF --><div class="md"><p>Running Llama-3-70B with long contexts and hitting HBM limits constantly. 128K context burns approx 40GB just for KV cache — half the H100 gone

<!-- SC_OFF --><div class="md"><p>A neat blog post with excellent visuals introducing ViTs from the ground up. The post covers: </p> <ul> <li>Patch embedding</li> <li>Positional

<!-- SC_OFF --><div class="md"><p>Every time one of our agents made a bad call in production, we had the same problem. Logs showed what happened. Nothing showed why it decided to

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1up47qv/ant_group_released_lingbotvision_dinofamily/"> <img alt="Ant Group released LingBot-Vision: