Serve Markdown to AI Agents with Accept Headers

<a href="https://news.ycombinator.com/item?id=49455713">Comments</a>

<a href="https://news.ycombinator.com/item?id=47486287">Comments</a>

<p>The AI crawl-and-summarize wave has landed. Google's Gemini, OpenAI's GPT, Anthropic's Claude, Perplexity — they're all hitting your site. If you serve them HTML, they waste

<p>Since early September, every public page of our website has had a Markdown twin, reachable by header or by URL. Two dedicated nginx logs have recorded every request through

<a href="https://news.ycombinator.com/item?id=47903471">Comments</a>

<a href="https://news.ycombinator.com/item?id=47867085">Comments</a>

<a href="https://news.ycombinator.com/item?id=50084416">Comments</a>

<a href="https://news.ycombinator.com/item?id=48791380">Comments</a>