AI Search Engine Optimization
---
Something interesting started quietly on April 1st, when a developer published a Python tool on Dev.to designed to test whether AI search engines — Perplexity, ChatGPT's browse mode, and their kin — can actually discover and parse your website. Not Google. Not Bing. The new category of search that answers questions rather than returning ten blue links. The tool itself was the tell: someone had felt the problem acutely enough to build a diagnostic for it. Eight days later, a second post appeared, this one walking through AI search optimisation for Jekyll — specifically structured data via JSON-LD, a file called `llms.txt`, and entity graphs. Two posts in nine days, from two different builders, independently arriving at the same territory. That is how a discipline begins.
The underlying shift these developers are responding to is real enough. AI-powered search engines do not crawl and rank the way traditional search does. They retrieve, synthesise, and cite. If your content is not structured in a way these systems can parse and attribute, you do not get a summary mention — you get nothing. The `llms.txt` convention, borrowed loosely from `robots.txt` logic, signals to large language models how to treat a site's content. JSON-LD entity graphs give AI systems the semantic scaffolding to understand what a site *is*, not just what words appear on it. These are not trivial tweaks. They represent a different mental model of what "findable" means.
If confirmed as a genuine emerging discipline, this matters in ways that compound quickly. Every website owner who has spent years on traditional SEO now faces a second optimisation layer — one with almost no established tooling, no dominant playbook, and no Google Search Console equivalent to tell you how you are performing. Developers who move early on this — building tools, writing frameworks, establishing conventions like `llms.txt` — will shape what the discipline becomes, the same way early SEO practitioners shaped web publishing habits for two decades. For businesses that depend on search-driven traffic, the risk is not that AI search replaces Google overnight. The risk is that their traffic quietly migrates to AI-answered queries and they never see the referral data that would tell them it happened.
Watch for wider platform adoption of `llms.txt` as a formal spec, or for a major CMS — WordPress, Ghost, Webflow — to ship native AI-search metadata support. Either would signal this has moved from hobbyist experiment to infrastructure.
<p>Perplexity AI is now a native search option in Firefox's address bar, and this single integration will funnel millions of users away from traditional search results into
<h1> Your FAQ is useless to AI. Here's how to fix it. </h1> <p>Your FAQ page probably won't show up in ChatGPT. And if it does, Claude won't cite it the same way Google would.
<!-- SC_OFF --><div class="md"><p>Is anyone else thinking about how the entire content architecture of the web needs to shift for the AI search era?</p> <p>Curious what signals
<h1> I Audited 70 Companies' llms.txt Files. Most Don't Have One. </h1> <p>The <code>/llms.txt</code> proposal has been around since late 2024. Two years in, every SEO blog has a
<p>If you're an engineering leader at a dev-tools company, an AI infrastructure platform, or an API-first SaaS, there's a good chance your marketing site is a React SPA — Vite,
<p>AI search recommends only 1.2% of local businesses. 68% of its business info is wrong. Consumers aren't checking. Nobody is measuring this failure — because the measurement
<h2> Your Website Is Invisible to AI </h2> <p>Open ChatGPT. Ask it: "What's a good Threads automation tool?"</p> <p>It gives you an answer. But whose website does it cite?</p>
<p>A growing share of web traffic doesn't come from people anymore. It comes from models reading on their behalf. ChatGPT, Claude, Perplexity, Copilot. They fetch a handful of
NewsHive monitors these sources continuously. All signal titles above link to the original reporting.
Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →