Is there a way to estimate tokens needed for tasks?

<!-- SC_OFF --><div class="md"><p><strong>TL;DR:</strong> Jensen Huang and China's data chief both declared tokens a &quot;commodity&quot; and &quot;settlement unit&quot; the same

<!-- SC_OFF --><div class="md"><p>A Meta employee built a leaderboard on the company intranet called &quot;Claudeonomics&quot; that ranks token usage across 85k employees. top 250

<p>Months after ChatGPT launched, I still could not have told you what a token was. I had been using it since the first public launch and was basically having novel-long

<!-- SC_OFF --><div class="md"><p>I often hear FANG employees discussing LLM budgets and token usage.</p> <p>So, a token is like a payment, right? Why don't they just say

<!-- SC_OFF --><div class="md"><p><a href="https://youtu.be/-0HRzXk8vlk?si=mLADk5b_dT9yxNiv">https://youtu.be/-0HRzXk8vlk?si=mLADk5b_dT9yxNiv</a></p> </div><!-- SC_ON --> &#32;

<!-- SC_OFF --><div class="md"><p>My app fans out prompts to multiple LLMs as the first step. I’m shocked to see that the token count returned by the API‘s is often 10 X what

<!-- SC_OFF --><div class="md"><p>We're obsessed with raw tokens per second. Every hardware post leads with it. Every quantization comparison is ranked by it. It's the one number

<!-- SC_OFF --><div class="md"><p>Suppose that somebody made a small box OpenClaw box that could run several thousands of tokens per second, with a model significant better model