Confirmed: SWE Bench is now a benchmaxxed benchmark

<table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1tpp0h1/a_coding_benchmark_that_matches_my_day_to_day/"> <img alt="A coding benchmark that matches my day to

&#32; submitted by &#32; <a href="https://www.reddit.com/user/ranandtoldthat"> /u/ranandtoldthat </a> <br /> <span><a

<!-- SC_OFF --><div class="md"><p>Every new model announcement leads with impressive SWE-bench numbers but buries whether the result is zero-shot or scaffolded. The delta is

<table> <tr><td> <a href="https://www.reddit.com/r/OpenAI/comments/1wphcxz/new_llm_benchmark_catbench/"> <img alt="New LLM Benchmark &quot;CatBench&quot;"

<!-- SC_OFF --><div class="md"><p>Working on evaluating some AI-generated outbound (SDR-style emails along with follow-ups), and I’m running into a weird problem. Everyone talks

<a href="https://news.ycombinator.com/item?id=47910388">Comments</a>

<!-- SC_OFF --><div class="md"><p>Benchmark: 58.4 vs 56.7 (beats GPT-5.4)</p> <p>License: Fully open (Apache 2.0) </p> <p>What it actually does: Runs 8-hour fully autonomous agent