Production Was Down… But Everything Looked Normal 🤯

<p><a class="article-body-image-wrapper"

<p>Your AI system isn't going to crash. It's going to drift.</p> <p>A recommendation engine making 1.4 model calls instead of 1. A retrieval pipeline fetching 5 chunks instead of

<p>Four agents entered an infinite loop in November 2025. They ran for 11 days. The bill was $47,000. Nobody noticed until it was over.</p> <p>The team was running a market

<p>The dry run said the reminder text would go out to a customer with the window "12PM–2PM." The actual appointment was 8AM–10AM. Four hours off, on a message the customer would

<p><em>The AWS Reliability Files, Part 1</em></p> <p>I told an AI a true fact about AWS. Then I had a second AI confidently insist it was wrong. Within one exchange, the first

<p>The thing that breaks before 1,000 users is almost never the code.</p> <p>Not a race condition. Not a memory leak. Not a missing index. Founders assume their app will collapse

<p><em>This is a submission for <a href="https://dev.to/bugsmash">DEV's Summer Bug Smash: Clear the Lineup</a> powered by <a href="https://sentry.io/" rel="noopener

<p>The check was fine. That is the part worth sitting with.</p> <p>I was auditing the structured data on our own site, the <code>sameAs</code> block that tells search engines