What publicly available benchmarks do you actually trust?

<!-- SC_OFF --><div class="md"><p>I’m wondering if instead I should be looking backwards and saying “I like model X, let’s see where it is on benchmarks” and then find others who

<!-- SC_OFF --><div class="md"><p>As the title reads, just looking for something which is genuine and not biased.</p> <p>Thanks.</p> </div><!-- SC_ON --> &#32; submitted by &#32;

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tq7b75/i_ran_some_benchmarks_using_omlx_tool_i_know_not/"> <img alt="I ran some benchmarks using oMLX tool

<!-- SC_OFF --><div class="md"><p>I have been following the akitaonrails coding benchmark which tests against a fixed rails + Rubyllm + docker task rather than vendor-reported

<!-- SC_OFF --><div class="md"><p>Are there any sites using a standard testing methodology that compare the different NPUs in Android phones? Qualcomm is the majority of the

&#32; submitted by &#32; <a href="https://www.reddit.com/user/peppaz"> /u/peppaz </a> <br /> <span><a href="https://devpadapp.com/anubis_bench_analysis.html">[link]</a></span>

<!-- SC_OFF --><div class="md"><p>Just out of curiosity i think everyone realize that new models are usually tuned down few weeks after the release to be cheaper so I'm just

<!-- SC_OFF --><div class="md"><p>I never think about that but recently saw a comment on reddit. Because every private benchmark must call vendor's API, how do we know they don't