NewsHive
CONTACT USANALYST PORTAL →
vibe_codingBACKGROUND

Bad evals, my own: five exercises from two LLM judges

BACKGROUND
1 SIGNALFIRST DETECTED 14 September 2026
Narrative synthesis pending — 1 signal collected.
How the story developed
Other feeds and industry voices
15 May
Five silent failure modes I codified after 35 effective days of solo ERP coding

<p><a class="article-body-image-wrapper"

REPORT · HOW · Dev.toOPEN STORY
2 Oct
Seven green checks and a team page that named its judges

<p>Shipshape, the hackathon portal I built for DOGFOOD 2026, gives every team a history panel on its team page and submission page: who joined, who edited the project, when it

REPORT · WHO · Dev.toOPEN STORY
25 Jul
I Fabricated a Claim About LLM Judges. Then I Ran the Apology Experiment.

<blockquote> <p><strong>Where this fits:</strong> A series aside, not a numbered Part. It is first an apology for a fabricated claim under Part 3; the experiment below is how I

REPORT · WHERE · Dev.toOPEN STORY
1 May
Skills Without Evals Are Just Markdown and Hope

<blockquote> <p><strong>TL;DR.</strong> I built an Anthropic Agent Skill for <code>@ngrx/signals</code> and ran it through the full eval pipeline: capability A/B benchmarks, token

REPORT · HOW · Dev.toOPEN STORY
Sources
Dev.to

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →